System and method for 3-dimension simulation of glasses

ABSTRACT

A 3D virtual simulation system and method that provide decision-making information for selection and purchase of eyeglasses is presented. The system is comprised of four major units: 3D graphic simulation unit, contents delivery unit intelligent, Customer Relation Management (CRM) unit and back-office unit. 3D graphic simulation unit generates 3D face models of a user face and eyeglasses, and fit those objects automatically on networked platforms at real-time. The 3D face model is created from photo images of the face with options to select hair models. The 3D eyeglasses model is generated by a systematic reverse engineering process with specially designed measuring device. Graphic simulation unit transacts with intelligent CRM unit, so that user behavior is tracked down for push-marketing activity. Contents are delivered in a form of service-on-demand and ASP (Application Service Provider). This system enables precise virtual simulation of wearing eyeglasses with real dimensions of face and eyeglasses models and provides data and tools for custom-made production of eyeglasses assisted by expert knowledge base.

BACKGROUND OF INVENTION

1. Field of Invention

The present invention relates to a system and method for 3D simulationof eyeglasses that provide decision-making information for selection andpurchase of eyeglasses with virtual simulation technology.

2. Description of the Prior Technology

Eyeglasses are optical products and the fashion products as well. Majorfactors in decision-making process in this type of products are theproduct features such as design, material and price. In offlinepurchase, these factors are normally determined by customer's own will,fashion trend and suggestion from sellers or opticians.

Above business transaction in offline environment generates somebarriers to adopt e-Commerce technologies on variety of onlineplatforms. This problem can be summarized as following.

Firstly, virtual-try-on of eyeglasses has been online environment isvery limited so far. Vast majority of current methods use 2D imageposition method that layers photo images of eyeglasses and face. Thisapproach has limitations by nature because 2D images do not fullydescribe the characteristics of eyeglasses products and faces.

Secondly, a customer should make his or her own decision to purchase anitem from online environment wherein very limited advice can beprovided. Even in case there is advising feature, it is not very likelythat the advise take characteristics of each customer into account as itis typically done in offline business. Therefore, in order to fullyutilize online business of eyeglasses, an intelligent service method toprovide dedicated support to customers as in offline space is needed.

Thirdly, e-Commerce on online platforms should provide its own advantagethat overcomes the limitations of offline business, such as displayingonly items in stock, inconsistency in advise from opticians andunreasonable pricing.

In the meantime, offline business also can be benefited by utilizingrecent advance in software technology for e-Commerce. As stated above,offline business relies on items in stock that are displayed in offlineshops. It has not been easy to sell items that are not actuallydisplayed in the shop and to deliver sufficient product information thatare out of stock with printed materials. Therefore, this convention haslimited range of selection from the customer's point of view and limitedsale opportunity from the seller's point of view.

In order to overcome the limitations in offline business stated above,number of image-based software technologies has been applied up topresent. Those can be categorized by 2D-based and 3D-based approaches.

2D-based approach is the most commonly used approach that manye-Commerce companies adopted in early stage of Internet business. Thisapproach utilizes an image composition method that layers photo imagesof eyeglasses and face models. This is a low-end solution forvirtual-try-on, but has many limitations due to its nature of 2D image.Especially, as eyeglasses design tends to highly curved shape, thisapproach does not provide exact information of the product by the imagesonly taken from front-side view.

On the other hand, by virtue of recent advance in computer graphics andprocessing power of CPU in personal computers, some of 3D basedapproaches have been researched in recent years. There have been mainlytwo different methods in this approach. The first method is so-called‘panorama image’ where series of 2D images are connected together, sothat a user can visualize 3D shape of eyeglasses as he or she moves themouse on the screen. This is a pseudo way of 3D visualization becausethere is actually no 3D entity is generated while proving a 3D-likeeffect. As this method does not maintain any 3D object, it is notpossible to publish interactive contents like placing eyeglasses modelonto a human face model. Therefore, this method has only been applied toenhance visual description of the eyeglasses product on the Internetplatforms.

SUMMARY OF INVENTION

The technical goal of the present invention is to overcome disadvantagesof preceding 2D and 3D approaches by providing the most realisticvirtual-try-on of eyeglasses using 3D geometrical entities foreyeglasses and face models.

Additional goal of the present invention is to provide an effectivedecision-making support by an intelligent Customer Relation Management(CRM) facility. This facility operates computer-based learning, analysisfor customer behavior, analysis for product preference, computer-basedadvice for fashion trend and design, and a knowledge base for acquiredinformation. This facility also provides a facility for custom-madeeyeglasses by that a customer can build his or her own design.

Often time, depending on the party who requests technical transactions,a technology can be categorized as ‘pull-type’ or ‘push-type’. Thetechnical components illustrated above can be categorized as pull-typetechnologies as the contents can be retrieved upon user's request.Meanwhile, the present invention also consists of push-type marketingtools that publish marketing contents by utilizing virtual-try-on ofeyeglass products on potential customers and deliver the contents viawired or wireless platforms without having user's request in advance.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 shows the service diagram for the 3D eyeglasses simulation systemover the network.

FIG. 2 shows the detail diagram of the 3D eyeglasses simulation system.

FIG. 3 a illustrates the texture generation flow for custom-madeeyeglasses.

FIG. 3 b shows an example of simulation of the custom-made eyeglasses.

FIG. 3 c shows an example of the 3D eyeglasses simulation systemimplemented on a mobile device.

FIG. 4 a and FIG. 4 b shows database structure of the 3D eyeglassessimulation system.

FIG. 5 shows a diagram for the 3D face model generation operative

FIG. 6 a, FIG. 6 b, FIG. 6 c and FIG. 6 d show predefined windows oftemplate for facial feature implemented in this invention.

FIG. 7, FIG. 8 and FIG. 9 illustrate operatives for facial feature andoutline profile extraction.

FIG. 10 illustrates the flow of the template matching method.

FIG. 11 to FIG. 14 show 3D face generation operative on client network.

FIG. 15 shows a real-time preview operative in 3D face model generationoperative.

FIG. 16 a shows an example of the 3D simulation system implemented onweb browser.

FIG. 16 b shows an example of the virtual fashion simulation using 3Dvirtual human model.

FIG. 17 shows the structure of intelligent CRM unit.

FIG. 18 illustrates the business model utilizing the present invention

FIG. 18 a shows an example of 1:1 marketing by e-mail.

FIG. 18 b shows an example of 1:1 marketing contents on mobile devices.

FIG. 19 shows the diagram for 3D eyeglasses model management operative.

FIG. 20 illustrates the flow for automatic eyeglasses fitting.

FIG. 21 shows the measuring device for reverse modeling of eyeglasses.

FIG. 22 a shows an example of a side view image imported from themeasuring device.

FIG. 22 b shows an example of a front view image imported from themeasuring device.

FIG. 22 c to FIG. 22 e show examples of parametric reverse modeling oflenses.

FIG. 22 f illustrates the flow of reverse modeling procedure ofeyeglasses.

FIG. 23 a to FIG. 27 show examples of detailed modeling of eyeglasses.

FIG. 28 and FIG. 29 illustrate the predefined fitting points forautomatic fitting of eyeglasses.

FIG. 30 to FIG. 35 b illustrate the process to fit 3D eyeglasses on to3D face model.

FIG. 36 illustrates the result of automatic fitting and virtual try-on.

FIG. 37 illustrates the fitting points in the head model forauto-fitting process.

FIG. 38 illustrates the fitting points in the eyeglasses model forauto-fitting process.

FIG. 39 illustrates the fitting points in the hair model forauto-fitting process.

FIG. 40 illustrates the fitting points in the head model from differentangle.

FIG. 41 illustrates the automatic fitting process of 3D hair model.

FIG. 42 illustrates the flow of the automatic fitting process for 3Deyeglasses simulation.

FIG. 43 illustrates the flow of the 3D eyeglasses simulation method.

FIG. 44 illustrates the flow of the avatar service flow over theinternet platforms.

FIG. 45 illustrates the overall flow of the eyeglasses simulation.

DESCRIPTION OF THE PREFERRED EMBODIMENT

The present invention provides a new system and method for 3D simulationof eyeglasses through real-time 3D graphics and intelligent knowledgemanagement technologies.

In the present invention to overcome the limitation in precedingtechnology, this virtual simulation system, connected to a computernetwork, generates a 3D face model of a user, fits the face model and 3Deyeglasses models selected by the user, and simulates them graphicallywith a database that stores the information of users, products, 3Dmodels and knowledge base. Above system is consist of following units: auser data processing unit to identify the user who needs to have anaccess to simulation system, and to generate a 3D face model of theuser; a graphic simulation unit where a user can visualize 3D eyeglassesmodel that is generated as the user selects a product in the database,and to place and to fit automatically in 3D space on user's face modelcreated in user data processing module; an intelligent CRM (CustomerRelation Management) unit that can advise the user by a knowledge basethat provides consulting information acquired by knowledge of fashionexpert, purchase history and customer behavior on various products.

User data processing unit comprises a user information managementoperative to identify authorized user who have a legal access to thesystem and to maintain user information at each transaction withdatabase and a 3D face model generation operative to create a 3D facemodel of a user by the information retrieved by the user.

3D face model generation operative comprises a data acquisitionoperative to generate a 3D face model of a user by a image capturingdevice connected to a computer, or by retrieving front or front-and-sideview of photo images of the face, or by manipulating 3D face modelstored in the database of 3D eyeglasses simulation system.

This operative also comprises a facial feature extraction operative togenerate feature points of a base 3D model as a user input a outlineprofile and feature points of the face on a device that displaysacquired photo images of the face, and to generate a base 3D model.Feature points of a face comprises predefined reference points onoutline profile, eyes, nose, mouth and ears of a face.

The 3D face model generation operative further comprises a 3D face modeldeformation operative to retrieve precise coordinates points by userinteraction, and to deform a base 3D model by relative displacement ofreference points from default location by calculated movement of featurepoints and other points in the vicinity.

The Facial feature extraction operative comprises a face profileextraction operative to extract outline profile of 3D face model fromthe reference points input by the user and a feature point extractionoperative to extract feature points that characterize the face of theuser from the reference points on of eyes, nose, mouth and ears input bythe user.

The 3D face model generation operative further comprises a facialexpression operative to deform a 3D face model at-real time to generatehuman expressions under user's control.

The 3D face model generation operative further comprises a facecomposition operative to create a new virtual model by combining a 3Dface model of a user generated by the face model deformation operativewith that of the others.

The 3D face model generation operative further comprises a face texturegeneration operative to retrieve texture information from photo imagesprovided by a user, to combine textures acquired from front and sideview of the photo images and to generate textures for the unseen part ofhead and face on the photo images.

The 3D face model generation operative further comprises a real-timepreview operative to display 3D face and eyeglasses models with textureover the network, and to display deformation process of the models.

The 3D face model generation operative further comprises a file managingoperative to create and save 3D face model in proprietary format and toconvert 3D face model data into industry standard formats.

The graphic simulation unit comprises a 3D eyeglasses model managementoperative to retrieve and store 3D model information on the database byuser interaction, a texture generation operative to create colors andtexture pattern of 3D eyeglasses models, and to store the data in thedatabase, and to display textures of 3D models on a monitor generated inuser data processing unit and eyeglasses modeling operative and avirtual-try-on operative to place 3D eyeglasses and face model in 3Dspace and to display.

The 3D eyeglasses model management operative comprise: an eyeglassesmodeling operative to create a 3D model and texture of eyeglasses and togenerate fitting parameters for virtual-try-on that include referencepoints for the gap distance between the eyes and lenses, hinges ineyeglasses and contact points on ears; a face model control operative tomatch fitting parameters generated in eyeglasses modeling operative.

The 3D virtual-try-on operative comprises: an automatic eyeglasses modelfitting operative to deform a 3D eyeglasses model to match a 3D facemodel automatically at real-time on precise location by using fittingparameters upon user's selection of eyeglasses and face model; ananimation operative to display prescribed animation scenarios toillustrate major features of eyeglasses models; a real-time renderingoperative to rotate, move, pan, and zoom 3D models by user interactionor by prescribed series of interaction.

The 3D virtual-try-on operative further comprises a custom-madeeyeglasses simulation operative to build user's own design by combiningcomponents of eyeglasses that include lenses, frames, hinges, templesand bridges from built-in library of eyeglasses models and texture andto place imported images of user's name or character to a specificlocation to build user's own design: to store simulated design in userdata processing unit.

The system for 3D simulation of eyeglasses further comprises a commercetransaction unit to operate a merchant process so that a user canpurchase the products after trying graphic simulation unit.

The commerce transaction unit comprises a purchase management operativeto manage orders and purchase history of a user, a delivery managementoperative to verify order status and to forward shipping information todelivery companies and a inventory management operative to manage thestatus of inventory along with payment and delivery process.

The intelligent CRM unit comprises: a product preference analysisoperative to analyze the preference on individual product by demographiccharacteristics of a user and of a category, and to store the analysisresult on knowledge base; a customer behavior analysis operative toanalyze the characteristics of a user's action on commerce contents, andto store the analysis result on knowledge base; an artificialintelligent learning operative to integrate analysis about from productpreference and customer behavior with fashion trend information providedby experts in fashion, and to forecast future trend of fashion fromacquired knowledge base; a fashion advise generation operative to createadvising data from the knowledge base and store it to the database of 3Deyeglasses simulation system, and to deliver dedicated consultinginformation upon user's demand that include design, style and fashiontrend suited for a specific user. The knowledge base comprises adatabase for log analysis and for advise on fashion trend.

In the present invention to overcome the limitation in precedingtechnology, a method for 3D simulation of eyeglasses for a 3D eyeglassessimulation system connected to a computer network to generate a 3D facemodel of a user, and to fit the face model and 3D eyeglasses modelsselected by the user, and to simulate them graphically with a databasethat stores the information of users, products, 3D models and knowledgebase comprises: a step to generate 3D face model of the user as the usertransmit photo images of his or her face to the 3D eyeglasses simulationsystem, or as the user select one of 3D face model stored in saiddatabase; a step to generate 3D eyeglasses model that selects one of 3Dmodels stored in said database and generates 3D model parameters of saideyeglasses model for simulation; a step to simulate virtual-try-on ondisplay monitor that fits said 3D eyeglasses and face model by deformingeyeglasses model at-real time, and that displays combined 3D mages ofeyeglasses and face model at different angles.

The he step to generate a 3D face model of the user comprises a step todisplay image information from the input provided by the user a step toextract an outline profile and feature points of said face as the userinput base feature points on displayed image information and a step tocreate a 3D face model by deforming base 3D model with a movement ofbase feature points observed during user interaction.

The step to extract an outline profile and feature points of said facecomprises a step to create a base snake as the user input base featurepoints that include facial features points along outline and featuredparts of the face, a step to define vicinity of said snake to move oneach points along the snake to vertical direction and a step to movesaid snake to the direction where color maps of the face in said imageinformation exist.

The step to extract outline profile and feature points of said faceextract similarity between image information of featured parts of theface input by the user and that of predefined generic model.

The step to create a 3D face model comprises a step to generate Sibsoncoordinates of the base feature points a step to calculate movement ofthe base feature points to that of said image information and step tocalculate a new coordinates of the base feature points as a summation ofcoordinates of the default position and the calculated movement.

The step to create a 3D face model comprises a step to calculatemovement coefficients as a function of movement of the base featurepoints and a step to calculate new positions of feature points near basepoints by multiplying movement coefficient.

The method for 3D simulation of eyeglasses further comprises a step togenerate facial expressions by deforming said 3D face model generatedfrom said step to create a 3D face model and by using additionalinformation provided by the user.

The step to generate facial expressions comprises a step to compute thefirst light intensity on the entire points over the 3D face model, astep to compute the second light intensity of the image informationprovided by the user, a step to calculate the ERI (Expression RatioIntensity) value with the ratio of said second light intensity over thatof said second and a step to warp polygons of the face model by usingthe ERI value to generate human expressions.

The method for 3D simulation of eyeglasses further comprises a step tocombine photo image information of the front and side view of the face,and to generate textures of the remaining parts of the head that areunseen by said photo image.

The generate textures of remaining parts of the head comprises a step togenerate Cartesian coordinates of said 3D face model and to generatetexture coordinates of the front and side image of the face, a step toextract a border of said two images and to project the border onto thefront and side views to generate textures in the vicinity of the borderon the front and side views and a step to blend textures from the frontand side views by referencing acquired texture on the border.

The method for 3D simulation of eyeglasses, before the step to generate3D face model of the user, comprises: the first step to check whetherthe user's 3D face model has been registered before or not; the secondstep to check whether the user will update registered models or not; thethird step to check whether the registered model has been generated byphoto image provided by the user or by built-in 3D face model library;the fourth step to load the selected model when it is generated form theinformation provided by the user.

The method for 3D simulation of eyeglasses further comprises: the fifthstep to confirm whether the user will generate a new face model or notwhen a stored model does not exist; the sixth step to display built-indefault models when the user does not want to generate a new model; theseventh to create an avatar from 3D face model generated by photo imageof the user by installing dedicated software on personal computer whenthe software has not been installed before in case the user wants togenerate a 3D face model; the eighth step to register the avatarinformation and to proceed to the third step to check whether the modelhas been registered or not.

The method for 3D simulation of eyeglasses proceeds to the seventh stepand to complete remaining process when the user wants to update the 3Dface model in the second step.

The method for 3D simulation of eyeglasses further comprises a step todisplay the last saved model that has been selected in said third step.

The method for 3D simulation of eyeglasses that checks whether the userhas been registered or not as in said first step and identifies that theuser is the first visitor comprises a step to check whether the userselect one of built-in default models or not after providing loginprocedure, a step to display selected default models on the monitor anda step to check to proceed to said seventh step if the user does notselect any of built-in default model.

The method for 3D simulation of eyeglasses further comprises a step toselect a design of frame and lenses, brand, color, materials or patternfrom built-in library for the user.

The step to generate 3D eyeglasses model that selects one of 3D modelsstored in the database further comprises a step to provide fashionadvise information to the user by intelligent CRM unit can advise theuser by a knowledge base that provides consulting information acquiredby knowledge of fashion expert, purchase history and customer behavioron various products.

The step to simulate on display monitor comprises: a step to scaleeyeglasses model with respect to X-direction, that is the lateraldirection of the 3D face model, by referencing fitting points ateyeglasses and face model that consists of the distance between face andfar end part of eyeglasses, hinges in eyeglasses and contact points onears; a step to transform coordinates of Y-direction, that is up anddownward direction to the 3D face model, and Z-direction, that is frontand backward direction to the 3D face model, with the scale calculatedin X-direction; a step deform temple part of the 3D eyeglasses model tomatch corresponding fitting points between 3D face and eyeglasses model.

The scale factor that scales the size of 3D eyeglasses model forautomatic fitting represented by:SF=X _(B) /X _(B)′,g=SF·G

Where, SF is the scale factor, X_(B)′ is the X-coordinate of the fittingpoint B′ for the hinge part of 3D eyeglasses model and X_(B) is theX-coordinate of the corresponding fitting point B for the 3D face modelG is the size of original 3D eyeglasses model and g is a scaled size ofthe model in X-direction.

The method for 3D simulation of eyeglasses comprises the movement inY-direction to close the gap between the fitting point B for 3D facemodel and the scaled fitting point b′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$where, ΔY is the movement of 3D eyeglasses model in Y-direction,(X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fitting point B′ forthe hinge part of the 3D eyeglasses model, (X_(B), Y_(B), Z_(B)) are thecoordinates of the corresponding fitting point B for the 3D face modeland Y_(b′) is the Y-coordinate of the scaled fitting point b′.

The method for 3D simulation of eyeglasses comprises the movement inZ-direction to close the gap between the fitting point A for 3D facemodel and the scaled fitting point a′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Z} = {{\left( {Z_{A} - \alpha} \right) - Z_{a^{\prime}}} = {Z_{A} + \alpha - {Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$a^{\prime} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point a′ and α is the relative distance between thetop centers of the lens and the eyebrow.

The method for 3D simulation of eyeglasses comprises the rotation angleθ_(y) in X-Z plane with respect to Y-axis represented by the anglecalculated from cosine function represented by:Cos θ_(y)=Cos(∠CB′C′) _(X-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

The method for 3D simulation of eyeglasses comprises the rotation angleθ_(x) in Y-Z plane with respect to X-axis represented by the anglecalculated from cosine function represented by:Cos θ_(x)=Cos(∠CB′C′) _(Y-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

In the present invention to overcome the limitation in precedingtechnology, a storage media to read a program to from a computer networkto generate a 3D face model of a user, and to fit the face model and 3Deyeglasses models selected by the user, and to simulate them graphicallywith a database that stores the information of users, products, 3Dmodels and knowledge base, to execute a program comprises: an operativeto generate 3D face model of the user as the user transmit photo imagesof his or her face to the 3D eyeglasses simulation system, or as theuser select one of 3D face model stored in said database; an operativeto generate 3D eyeglasses model that selects one of 3D models stored insaid database and generates 3D model parameters of said eyeglasses modelfor simulation; an operative to simulate virtual-try-on on displaymonitor that fits said 3D eyeglasses and face model by transforming theY and Z-coordinates of 3D eyeglasses model with the scale factorcalculated from X-direction, using the gap distance between the eyes andthe lenses and the fitting points for the ear part of the face model andfor the hinge and the temple part of the eyeglasses model, and thatdisplays combined 3D images of eyeglasses and face model at differentangles.

The method to generate a 3D face model comprises: (a) a step to input a2D photo image of a face in front view and to display said image; (b) astep to input at least one base points, on the said image, thatcharacterizes a human face; (c) a step to extract an outline profile andfeature points for eyes, nose, mouth and ears that construct featureshapes of said face; (d) a step to convert said input image informationto a 3D face model using said outline profile and feature points.

The base points include at least one points in the outline profile ofthe face, and the step (c) to extract the outline profile of the facecomprises: (c1) a step to generate a base snake on said face informationon said image referencing said base points; (c2) a step to extract theoutline profile by moving snake of the said face to the direction wheretextures of the face exist.

The base points include at least one points that correspond to eyes,nose, mouth and ears, and the step (c) to extract the outline profile ofthe face comprises: a step to comprise a standard image information fora standard 3D face model; (c2) a step to extract feature points of saidinput image by analyzing the similarity in image information of thefeatured shape and that of the standard image.

The step (a) to input said 2D image provides a facility to zoom in, zoomout or rotate said image upon user's demand, and the step (b) comprises:(b1) a step to input the size and degree of rotation of the said imageby the user; (b2) a step to generate a vertical center line for the faceand to input base points for outline profile of the face, the step (c)comprises: (c1) a step to generate base snake of the face by the saidbase points of the said image of the face; (c2) a step to extractoutline profile of the face by moving said snake to the direction wheretexture of the face exist; (c3) a step to comprise standard imageinformation for 3D face model; (c4) a step to extract feature points ofsaid input image by analyzing the similarity in image information of thefeatured shape and that of the standard image; (c5) a step to displaythe outline profile or the feature points along the outline profile tothe user, and to provide a facility to modify said profile or featurepoints, and to finalize the outline profile and feature points of saidface.

The method to generate a 3D face model further comprises: (e) a step togenerate 3D face model by deforming said face image information usingthe movement of base feature points in the standard image information toextracted feature points by user interaction on said face image.

The step (e) comprises: (e1) a step to generate Sibson coordinates onthe original position of the base points extracted from the step todeform said face model; (e2) a step to calculate movements of each basepoints to the corresponding position of said image information; (e3) astep to calculate a new position with a summation of coordinates of theoriginal positions and said movements; (e4) a step to generate 3D facemodel that corresponds to adjusted image information, by new positions,of said face.

The step (e) comprises: (e1) a step to calculate the movement of basepoints; (e2) a step to calculate new positions of base points and theirvicinity that have by using said movement; (e3) a step to generate 3Dface model that corresponds to adjusted image information, by newpositions, of said face.

The method to generate a 3D face model further comprises: (f) a step togenerate facial expressions by deforming said 3D face model generatedfrom said step to create a 3D face model and by using additionalinformation provided by the user.

The method to generate a 3D face model, the step (f) comprises: (f1) astep to compute the first light intensity on the entire points over the3D face model; (f2) a step to compute the second light intensity of theimage information provided by the user; (f3) a step to calculate the ERI(Expression Ratio Intensity) value with the ratio of said second lightintensity over that of said second; (f4) a step to warp polygons of theface model by using the ERI value to generate human expressions.

The method to generate a 3D face model further comprises: (g) a step tocombine photo image information of the front and side view of the face,and to generate textures of the remaining parts of the head that areunseen by said photo image.

The step (g) comprises: (g1) a step to generate Cartesian coordinates ofsaid 3D face model and to generate texture coordinates of the front andside image of the face; (g2) a step to extract a border of said twoimages and to project the border onto the front and side views togenerate textures in the vicinity of the border on the front and sideviews; (g3) a step to blend textures from the front and side views byreferencing acquired texture on the border.

The method to generate a 3D face model further comprises: (h) a step toprovide a facility for the user to select a hair models from a built-inlibrary of 3D hair models, and to fit said hair model onto said 3D facemodel.

The step (h) comprises: (h1) a step to comprise a library of 3D hairmodels in at least one category in hair style; (h2) a step for the userto select a hair model from the built-in library of 3D hair models; (h3)a step to extract a fitting point for the 3D hair model that matches thetop position of the scalp on the vertical center line of said 3D facemodel; (h4) a step to calculate the scale that matches to said 3D facemodel, and to fit 3D hair and face model together by using said fittingpoint for the hair.

In the present invention to overcome the limitation in precedingtechnology, the method for 3D simulation of eyeglasses comprising: (a) astep to acquire photographic image information from front, side and topviews of eyeglasses placed in a cubic box with a measure in transparentmaterial; (b) a step to generate a base 3D model for eyeglasses by usingmeasured value from said images or by combining components from abuilt-in library for 3D eyeglasses component models and textures; (c) astep to generate a 3D lens model parametrically with the geometricinformation about lens shape, curvature, slope and focus angle; (d) astep to generate a shape of the bridge and frame of eyeglasses by usingmeasured value from said image and to combine said lenses, bridge andframe model together to generate a 3D complete model for eyeglasses.

The step (c) comprises: (c1) a step to acquire curvature informationfrom said images or by specification of the product, and to create asphere model that matches said curvature or predefined curvaturepreference; (c2) a step to project the outline profile the lens to thesurface of the sphere model and to trim out inner part of the projectedsurface.

The method for 3D simulation of eyeglasses further comprises: (c3) astep to generate thickness on trimmed surface of the lens.

The method for 3D simulation of eyeglasses, the step (d) comprises: (d1)a step to display the base 3D model to the user, and to acquire inputparameters for adjusting the 3D frame model, and to deform said framemodel with acquired parameters; (d2) a step to mirror said 3D lens modelwith respect to center line defined by user input or measured by saidphoto images and generate a pair of lenses in symmetry, and to generatea 3D bridge model with the parameters defined by user input or measuredby said photo images.

The step (d) further comprises: (d3) a step to generate a connectionpart of the 3D frame model between temple and lens frame with theparameters defined by user input or measured by said photo images, or bythe built-in 3D component library.

The method for 3D simulation of eyeglasses further comprises: (e) a stepto generate temple part of the 3D frame model with the parametersdefined by user input or measured by said photo images, or by thebuilt-in 3D component library, while matching topology of saidconnection part and to convert automatically in a format of polygons;(f) a step to deform temple part of the 3D frame model to match thecurvature measured by said photo images or predefined curvaturepreference; (g) a step to mirror said 3D temple model with respect tocenter line defined by user input or measured by said photo images andgenerate a pair of lenses in symmetry.

The method for 3D simulation of eyeglasses further comprises: (h) a stepto generate a nose part, a hinge part, screws, bolts and nuts from withthe parameters defined by user input or built-in 3D component library.

In the present invention to overcome the limitation in precedingtechnology, the method for 3D simulation of eyeglasses comprises: (a) astep to comprise at least one 3D eyeglasses and 3D face modelinformation; (b) a step to select a 3D face model and 3D eyeglassesmodel by a user from said model information; (c) a step to fitautomatically said face and eyeglasses model at-real time; (d) a step tocompose a 3D image of said face and eyeglasses model, and to displaygenerated said 3D image upon the user's demand.

The step (c) comprises: (c1) a step to adjust to the scale of the 3Deyeglasses model in X-direction, that is the lateral direction of the 3Dface model, with the fitting points for hinge part of the 3D eyeglassesmodel, for corresponding fitting points in 3D face model, for top centerof the ear part of the 3D face model, for gap distance between eyes andlenses; (c2) a step to transform the coordinates and the location of 3Deyeglasses model in Y-direction, that is up and downward direction tothe 3D face model, and Z-direction, that is front and backward directionto the 3D face model, with the scale calculated in X-direction; (c3) astep to deform temple part of the 3D eyeglasses model to matchcorresponding fitting points between 3D face and eyeglasses model.

The step (c1) comprises the scale factor that scales the size of 3Deyeglasses model for automatic fitting represented by:SF=X _(B) /X _(B)′,g=SF·G

Where, SF is the scale factor, X_(B)′ is the X-coordinate of the fittingpoint B′ for the hinge part of 3D eyeglasses model and X_(B) is theX-coordinate of the corresponding fitting point B for the 3D face model,G is the size of original 3D eyeglasses model and g is a scaled size ofthe model in X-direction.

The method for 3D simulation of eyeglasses comprises the movement inY-direction to close the gap between the fitting point B for 3D facemodel and the scaled fitting point b′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$

Where, ΔY is the movement of 3D eyeglasses model in Y-direction,(X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fitting point B′ forthe hinge part of the 3D eyeglasses model, (X_(B), Y_(B), Z_(B)) are thecoordinates of the corresponding fitting point B for the 3D face modeland Y_(b′) is the Y-coordinate of the scaled fitting point b′.

The method for 3D simulation of eyeglasses comprises the movement inZ-direction to close the gap between the fitting point A for 3D facemodel and the scaled fitting point a′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Z} = {{\left( {Z_{A} - \alpha} \right) - Z_{a^{\prime}}} = {Z_{A} + \alpha - {Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$a^{\prime} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point α′ and α is the relative distance between thetop centers of the lens and the eyebrow.

The method for 3D simulation of eyeglasses comprises the rotation angleθ_(y) in X-Z plane with respect to Y-axis represented by the anglecalculated from cosine function represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

The method for 3D simulation of eyeglasses comprises the rotation angleθ_(x) in Y-Z plane with respect to X-axis represented by the anglecalculated from cosine function represented by:Cos θ _(x)=Cos(∠CB′C′)_(Y-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

The step (c) comprises: (c1) a step to input center points of thefitting region, NF, CF, DF, NG, HG and CG, in that 3D eyeglasses modeland 3D face model contact each other, where NF is the center point ofsaid 3D face model, CF is the center top of the ear part of said 3D facemodel that contacts the temple part of the 3D eyeglasses model duringvirtual-try-on, DF is the point at the top of the scalp, NG is thecenter of the nose part of said 3D face model that contacts the nose padpart of the 3D eyeglasses model during virtual-try-on, HG is therotational center of hinge part of the 3D eyeglasses model and CG is thecenter of inner side of the temple part of the 3D eyeglasses model thatcontact said ear part of the 3D face model; (c2) a step to obtain newcoordinates set for said 3D eyeglasses model using said value of NF, CF,DF, NG, HG and CG that are need to fit eyeglasses on face model; (c3) astep to fit said 3D eyeglasses model on said 3D face model automaticallyat-real time.

The step (c2) comprises; (c2i) a step to move said 3D eyeglasses modelto proper position by using the difference of said NF and said NG;(c2ii) a step for the user to input his or her own PD, pupillarydistance, and to calculate PD value of said 3D face and correspondingvalue of 3D eyeglasses model; (c2iii) a step to calculate the rotationangles for the template part of said eyeglasses model in horizontalplane to be fitted on said 3D face model by using said CF and HG value;(c2iv) a step to deform 3D eyeglasses model and to fit on said 3D facemodel by using said values and angles.

The step (c2ii) comprises a step to define a value between 63 and 72millimeters without having input from the user.

In the present invention to overcome the limitation in precedingtechnology, an eyeglasses marketing method comprises: (a) a step togenerate 3D face model of a user a with a photo image of the face, andto generate image information to combine said 3D face model and stored3D eyeglasses model, and to deliver said image information to acustomer; (b) a step to retrieve at least one selection of the 3Deyeglasses model by the user, and to manage purchase inquiry informationof the eyeglasses, that corresponds to 3D eyeglasses model, inputted bythe user; (c) a step to analyze the environment where said purchaseinquiry occurs including analysis or occasion of customer behavior onthe corresponding inquiry and eyeglass product; (d) a step to analyzethe customer's preference on eyeglasses product inquired and to managethe preference result; (e) a step to forecast trend future trend offashion driven from said analysis step for product preference andanalysis result for customer behavior and acquired information oneyeglasses fashion; (f) a step to acquire future trend of fashion by anartificial intelligent learning tool dedicated to fashion trendforecast, and to generate a knowledge base that advise suited design orproper fashion trend upon customer's request; (g) a step to generate apromotional contents for eyeglasses for a specific customer based on theintegrated information about customer preference obtained from saidcustomer behavior analysis tool, advising information generated by saidknowledge base and artificial intelligent learning tool; (h) a step toacquire and manage demographic information of the user including emailaddress or phone numbers, and to deliver promotional contents to thecustomer as a 1:1 marketing tool.

The step (g) comprises a step to categorize customers by a predefinedrule and to generate promotional contents according to said category.

The step (d) and (e) comprises analysis for the customer that includesat least one parameter for hair texture of 3D face model of thecustomer, lighting of the face, skin tone, width of the face, length ofthe face, size of the mouth, interpupillary distance and race of thecustomer.

The step (d) comprises the analysis for the eyeglasses product thatincludes at least one parameter for size of the frame and lenses, shapeof the frame and lenses, material of the frame and lenses, color of theframe, color of the lenses, model year, brand and price.

The step (d) comprises analysis for the product preference that includesat least one parameter for seasonal trend in fashion, seasonal trend ofeyeglasses shape, width of the face, race, skin tone, interpupillarydistance, and hairstyle in the 3D face model.

In the present invention to overcome the limitation in precedingtechnology, a device to generate a 3D face model comprises: an operativeto input a 2D photo image of a face in front view and to display saidimage and to input at least one base points, on the said image, thatcharacterizes a human face; an operative to extract an outline profileand feature points for eyes, nose, mouth and ears that construct featureshapes of said face; an operative to convert said input imageinformation to a 3D face model using said outline profile and featurepoints.

The base points include at least one points in the outline profile ofthe face, and said operative to extract the outline profile of the facecomprises: an operative to generate a base snake on said faceinformation on said image referencing said base points; an operative toextract the outline profile by moving snake of the said face to thedirection where textures of the face exist.

The base points include at least one points that correspond to eyes,nose, mouth and ears, and the operative to extract the outline profileof the face comprises: a database to comprise a standard imageinformation for a standard 3D face model; an operative to extractfeature points of said input image by analyzing the similarity in imageinformation of the featured shape and that of the standard image.

The operative to input said 2D image provides a facility to zoom in,zoom out or rotate said image upon user's demand, retrieves the size anddegree of rotation of the said image by the user, and generates avertical center line for the face and to input base points for outlineprofile of the face, the operative to extract the outline profile of theface comprises: an operative to generate base snake of the face by thesaid base points of the said image of the face and to extract outlineprofile of the face by moving said snake to the direction where textureof the face exist; an operative to comprise a database of standard imageinformation for 3D face model; an operative to extract feature points ofsaid input image by analyzing the similarity in image information of thefeatured shape and that of the standard image; an operative to displaythe outline profile or the feature points along the outline profile tothe user, and to provide a facility to modify said profile or featurepoints, and to finalize the outline profile and feature points of saidface.

The device to generate a 3D face model further comprises an operative togenerate 3D face model by deforming said face image information usingthe movement of base feature points in the standard image information toextracted feature points by user interaction on said face image.

The operative to deform 3D face model comprises an operative to generateSibson coordinates on the original position of the base points extractedfrom the operative to deform said face model, an operative to calculatemovements of each base points to the corresponding position of saidimage information, an operative to calculate a new position with asummation of coordinates of the original positions and said movementsand an operative to generate 3D face model that corresponds to adjustedimage information, by new positions, of said face.

The operative to deform 3D face model an operative to calculate themovement of base points, an operative to calculate new positions of basepoints and their vicinity that have by using said movement and anoperative to generate 3D face model that corresponds to adjusted imageinformation, by new positions, of said face.

The device to generate a 3D face model further comprises an operative togenerate facial expressions by deforming said 3D face model generatedfrom said operative to create a 3D face model and by using additionalinformation provided by the user.

The operative to generate facial expressions comprises an operative tocompute the first light intensity on the entire points over the 3D facemodel, an operative to compute the second light intensity of the imageinformation provided by the user, an operative to calculate the ERI(Expression Ratio Intensity) value with the ratio of said second lightintensity over that of said second and an operative to warp polygons ofthe face model by using the ERI value to generate human expressions.

The device to generate a 3D face model further comprises an operative tocombine photo image information of the front and side view of the face,and to generate textures of the remaining parts of the head that areunseen by said photo image.

The operative comprises: an operative to generate Cartesian coordinatesof said 3D face model and to generate texture coordinates of the frontand side image of the face; an operative to extract a border of said twoimages and to project the border onto the front and side views togenerate textures in the vicinity of the border on the front and sideviews; an operative to blend textures from the front and side views byreferencing acquired texture on the border.

The device to generate a 3D face model further comprises an operative toprovide a facility for the user to select a hair models from a built-inlibrary of 3D hair models, and to fit said hair model onto said 3D facemodel.

The operative comprises: an operative to comprise a library of 3D hairmodels in at least one category in hair style; an operative for the userto select a hair model from the built-in library of 3D hair models; anoperative to extract a fitting point for the 3D hair model that matchesthe top position of the scalp on the vertical center line of said 3Dface model; an operative to calculate the scale that matches to said 3Dface model, and to fit 3D hair and face model together by using saidfitting point for the hair.

In the present invention to overcome the limitation in precedingtechnology, a device to generate a 3D eyeglasses model comprising: anoperative to acquire photographic image information from front, side andtop views of eyeglasses placed in a cubic box with a measure intransparent material; an operative to generate a base 3D model foreyeglasses by using measured value from said images; an operative togenerate a 3D lens model parametrically with the geometric informationabout lens shape, curvature, slope and focus angle; an operative togenerate a shape of the bridge and frame of eyeglasses by using measuredvalue from said image and to combine said lenses, bridge and frame modeltogether to generate a 3D complete model for eyeglasses.

The operative to generate a 3D lens model comprises an operative toacquire curvature information from said images and to create a spheremodel that matches said curvature or predefined curvature preference,and an operative to project the outline profile the lens to the surfaceof the sphere model and to trim out inner part of the projected surface.

The device to generate a 3D eyeglasses model further comprises anoperative to generate thickness on trimmed surface of the lens.

The operative to generate a 3D model comprises: an operative to displaythe base 3D model to the user, and to acquire input parameters foradjusting the 3D frame model, and to deform said frame model withacquired parameters; an operative to mirror said 3D lens model withrespect to center line defined by user input or measured by said photoimages and generate a pair of lenses in symmetry, and to generate a 3Dbridge model with the parameters defined by user input or measured bysaid photo images.

The operative to generate a 3D model comprises further comprises anoperative to generate a connection part of the 3D frame model betweentemple and lens frame with the parameters defined by user input ormeasured by said photo images, or by built-in 3D component library.

The device to generate a 3D eyeglasses model further comprises: anoperative to generate temple part of the 3D frame model while matchingtopology of said connection part and to convert automatically in aformat of polygons; an operative a step to deform temple part of the 3Dframe model to match the curvature measured by said photo images orpredefined curvature preference; an operative a step to mirror said 3Dtemple model with respect to center line defined by user input ormeasured by said photo images and generate a pair of lenses in symmetry.

The device to generate a 3D eyeglasses model further comprises anoperative to generate a nose part, a hinge part, a screw, a bolt and anut from with the parameters defined by user input or built-in 3Dcomponent library.

In the present invention to overcome the limitation in precedingtechnology, a device for 3D simulation of eyeglasses is consist of: adatabase that comprises at least one 3D eyeglasses and 3D face modelinformation; an operative to select a 3D face model and 3D eyeglassesmodel by a user from said model information; an operative to fitautomatically said face and eyeglasses model at-real time; an operativeto compose a 3D image of said face and eyeglasses model, and to displaygenerated said 3D image upon the user's demand.

The operative to fit eyeglasses model comprises: an operative to adjustto the scale of the 3D eyeglasses model in X-direction, that is thelateral direction of the 3D face model, with the fitting points forhinge part of the 3D eyeglasses model, for corresponding fitting pointsin 3D face model, for top center of the ear part of the 3D face model,for gap distance between eyes and lenses; an operative to transform thecoordinates and the location of 3D eyeglasses model in Y-direction, thatis up and downward direction to the 3D face model, and Z-direction, thatis front and backward direction to the 3D face model, with the scalecalculated in X-direction; an operative to deform temple part of the 3Deyeglasses model to match corresponding fitting points between 3D faceand eyeglasses model.

The operative to adjust the scale comprises the scale factor that scalesthe size of 3D eyeglasses model for automatic fitting represented by:SF=X _(B) /X _(B)′,g=SF·G

Where, SF is the scale factor, X_(B)′ is the X-coordinate of the fittingpoint B′ for the hinge part of 3D eyeglasses model and X_(B) is theX-coordinate of the corresponding fitting point B for the 3D face model,G is the size of original 3D eyeglasses model and g is a scaled size ofthe model in X-direction.

The device for 3D simulation of eyeglasses comprises the movement inY-direction to close the gap between the fitting point B for 3D facemodel and the scaled fitting point b′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$where, ΔY is the movement of 3D eyeglasses model in Y-direction,(X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fitting point B′ forthe hinge part of the 3D eyeglasses model, (X_(B), Y_(B), Z_(B)) are thecoordinates of the corresponding fitting point B for the 3D face modeland Y_(b′) is the Y-coordinate of the scaled fitting point b′.

The device for 3D simulation of eyeglasses comprises the movement inZ-direction to close the gap between the fitting point A for 3D facemodel and the scaled fitting point a′ by said scale factor for the hingepart of 3D eyeglasses model represented by:${\Delta\quad Z} = {{\left( {Z_{A} - \alpha} \right) - Z_{a^{\prime}}} = {Z_{A} + \alpha - {Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$a^{\prime} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point a′ and α is the relative distance between thetop centers of the lens and the eyebrow.

The device for 3D simulation of eyeglasses comprises the rotation angleθ_(y) in X-Z plane with respect to Y-axis represented by the anglecalculated from cosine function represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

The device for 3D simulation of eyeglasses comprises the rotation angleθ_(x) in Y-Z plane with respect to X-axis represented by the anglecalculated from cosine function represented by:

where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

The operative to fit 3D eyeglasses comprises: an operative to inputcenter points of the fitting region, NF, CF, DF, NG, HG and CG, in that3D eyeglasses model and 3D face model contact each other, where NF isthe center point of said 3D face model, CF is the center top of the earpart of said 3D face model that contacts the temple part of the 3Deyeglasses model during virtual-try-on, DF is the point at the top ofthe scalp, NG is the center of the nose part of said 3D face model thatcontacts the nose pad part of the 3D eyeglasses model duringvirtual-try-on, HG is the rotational center of hinge part of the 3Deyeglasses model and CG is the center of inner side of the temple partof the 3D eyeglasses model that contact said ear part of the 3D facemodel; an operative to obtain new coordinates set for said 3D eyeglassesmodel using said value of NF, CF, DF, NG, HG and CG that are need to fiteyeglasses on face model; an operative to fit said 3D eyeglasses modelon said 3D face model automatically at-real time.

The operative to obtain new coordinates comprises; an operative to movesaid 3D eyeglasses model to proper position by using the difference ofsaid NF and said NG; an operative a step for the user to input his orher own PD, pupillary distance, and to calculate PD value of said 3Dface and corresponding value of 3D eyeglasses model; an operative a stepto calculate the rotation angles for the template part of saideyeglasses model in horizontal plane to be fitted on said 3D face modelby using said CF and HG value; an operative a step to deform 3Deyeglasses model and to fit on said 3D face model by using said valuesand angles.

The step (c2ii) comprises a step to define a value between 63 and 72millimeters without having input from the user.

In the present invention to overcome the limitation in precedingtechnology, a device for marketing of eyeglasses comprises: an operativeto generate 3D face model of a user a with a photo image of the face,and to generate image information to combine said 3D face model andstored 3D eyeglasses model, and to deliver said image information to acustomer; an operative to retrieve at least one selection of the 3Deyeglasses model by the user, and to manage purchase inquiry informationof the eyeglasses, that corresponds to 3D eyeglasses model, inputted bythe user; an operative to analyze the environment where said purchaseinquiry occurs including analysis or occasion of customer behavior onthe corresponding inquiry and eyeglass product; an operative to analyzethe customer's preference on eyeglasses product inquired and to managethe preference result; an operative to forecast trend future trend offashion driven from said analysis step for product preference andanalysis result for customer behavior and acquired information oneyeglasses fashion; an operative to acquire future trend of fashion byan artificial intelligent learning tool dedicated to fashion trendforecast, and to generate a knowledge base that advise suited design orproper fashion trend upon customer's request; an operative to generate apromotional contents for eyeglasses for a specific customer based on theintegrated information about customer preference obtained from saidcustomer behavior analysis tool, advising information generated by saidknowledge base and artificial intelligent learning tool; an operative toacquire and manage demographic information of the user including emailaddress or phone numbers, and to deliver promotional contents to thecustomer as a 1:1 marketing tool.

The operative to provide 1:1 marketing tool comprises an operative tocategorize customers by a predefined rule and to generate promotionalcontents according to said category.

The device for marketing of eyeglasses comprises analysis for thecustomer that includes at least one parameter for hair texture of 3Dface model of the customer, lighting of the face, skin tone, width ofthe face, length of the face, size of the mouth, interpupillary distanceand race of the customer.

The device for marketing of eyeglasses comprises the analysis for theeyeglasses product that includes at least one parameter for size of theframe and lenses, shape of the frame and lenses, material of the frameand lenses, color of the frame, color of the lenses, model year, brandand price.

The device for marketing of eyeglasses comprises analysis for theproduct preference that includes at least one parameter for seasonaltrend in fashion, seasonal trend of eyeglasses shape, width of the face,race, skin tone, interpupillary distance, and hairstyle in the 3D facemodel.

DESCRIPTION OF THE PREFERRED EMBODIMENT

The embodiments of the present invention will be illustrated withreference to accompanying drawings.

FIG. 1 is an example of the service for 3D eyeglasses simulation systemover the network.

As illustrated in FIG. 1, 3D eyeglasses simulation system (10) isconnected to a communication device (20) of a customer (user) viatelecommunication networks such as Internet that are available byinternet service providers (70). A user can generate his or her own 3Dface model and try that on 3D eyeglasses model that have been generatedby the system (70) beforehand. An intelligent Customer RelationManagement (CRM) knowledge base incorporated in the system assistsdecision-making process of customers by analyzing fashion trend andcustomer behavior and delivers advice information to different types oftelecommunication form factors (60).

A user can use a photo image of his or her own face by using imagecapturing device attached to user's communication device (20) such as aweb-camera or a digital camera, or can retrieve a image that is storedin the system (10), or just can try 3D simulation with provided built-insample avatars.

3D eyeglasses simulation system (10) provides merchant process when theuser requests purchase inquiry after virtual-try-on of eyeglasses: Thesystem (10) can be operated by a eyeglasses manufacturer (40), a seller(50) directly by its personnel or indirectly by partnership withindependent service providers. For the latter case, log data andmerchant information is delivered to the manufacturer (40). Upon arrivalof the purchase information, the manufacturer delivers the products tothe sellers using electronically managed logistics pipeline.

A service provider (70) provides liable services to customers,manufacturers (40), or sellers (50) by allowing authorized permissionsto 3D eyeglasses system (10). In addition, an electronic cataloguepublished by the manufacturer (40) or the seller (50) can be integratedwith the system (10) and can also be the other e-Commerce platforms.

The manufacturer (40) or the seller (50) can utilize 3D eyeglassessimulation system (10) as a way to promote eyeglasses product bydelivering virtual-try-on contents to customers (20), buyers (40) andother sellers (50) through telecommunication form factors (60).

3D eyeglasses simulation system (10) not only provides online servicethrough telecommunication networks, but also provides a facility topublish software and database to embed in variety of platforms such asKiosk, tablet-PC, pocket-PC, PDA, smart display and mobile phones (60).With this compatibility, offline business also can benefit fromsimulative technology.

When 3D eyeglasses system is published in a storage media anddistributed in offline market, eyeglasses selection process is performedin offline space by a customer who visits the shop or the show room,generated information is delivered to online platforms automatically.Once the user's information has been stored in the database of thesystem (10), the user can perform remaining process in onlineenvironment (70). This service is extended to provide custom-madeproduction service to a customer by that a user can build his or her owndesign with the 3D face model information of the user acquired inoffline space.

1. A System for 3D Simulation of Eyeglasses

In FIG. 2 overall structure of 3D eyeglasses simulation system (10) isillustrated.

As shown in FIG. 2, 3D eyeglasses simulation system (10) comprises ofinterface operative (100), data processing unit (110), graphicsimulation unit (120), commerce transaction unit (130), intelligent CRMunit (140) and database (150).

The database (150) comprises of user information DB (152), product DB(154), 3D model DB (156), commerce information DB (158) and knowledgebase DB (160). Each individual database is correlated each other withinthe sytem (10). The Interface operative (100) performs communication inbetween 3D eyeglasses simulation system (10), user (20), eyewearmanufacturer (40) and service provider (70). This operative (100)authorizes user information to connect the server and transfers customerpurchase history information to the database.

The user data processing unit (110) authorizes user information toconnect the server and transfers customer purchase history informationto the database. The user management operative (112) verifies theauthorized user who is maintained in user information DB (152), andupdate the user information DB (152) and commerce information DB uponchanges in the user profile.

The 3D face model generation operative (114) creates a 3D face model ofa user from photo image information provided by the user. The Images canbe retrieved by image capturing device connected to user's computer(20), or by uploading user's own facial images with a dedicatedfacility, or by selecting images among the ones stored in the database(150). This operative accepts one or two images, for front and sideview, as input.

The graphic simulation unit (120) provides a facility where the user canselect eyeglasses he or she wants, and generate a 3D eyeglasses modelfor selected eyeglasses, and simulate virtual try-on of eyeglasses with3D face model generated by the 3D face model generation operative (114).Graphic simulation unit (120) consists of 3D eyeglasses model managementoperative (122), texture generation operative (124) and virtual try-onoperative (126).

The graphic simulation unit (120) also provides a facility where a usercan build his or her own design by simulating design, texture andmaterial of eyeglasses together with 3D model generated beforehand. Theuser can also add a logo or character to build his or own design. Thisfacility enables operation of ‘custom-made’ eyeglasses contents, and theintelligent CRM unit (140) complement this contents by providing highlypersonalized advice on fashion trend and customer characteristics.

The texture generation management operative (124) provides a facilitythat a user can select and apply a color or texture of eyeglasses thathe or she wants. FIG. 3 a illustrates the flow of texture generationprocess. As shown in FIG. 3 b, a user can select a color or texture ofeach component of the eyeglasses such as frame, nose-pads, bridge,hinge, temples and lenses. The selected model can be rotated,translated, zoomed or animated at real-time as the user operates themouse pointer.

The commerce transaction unit (130) performs entire merchant process asthe user proceeds to purchase eyeglasses product after 3D simulation(10) is done. This unit (130) consists of purchase management operative(132), delivery management operative (134) and inventory managementoperative (136).

The purchase management operative (132) manages the user datainformation DB (152) and commerce information DB (158) that maintainsthe order information such as information about product, customer,price, tax, shipping and delivery.

The delivery management operative (134) provides a facility thatverifies the order status, transfers the order information to a shippingcompany and requests to deliver the product. The inventory managementoperative (136) manages the inventory information of eyeglasses in 3Deyeglasses simulation system (10) throughout purchase process.

Intelligent CRM unit (140) can learn new trends of customer behaviorwith fashion trend information provided by experts in fashion and thenforecast future trends of fashion from acquired knowledge baseeffectively.

Detailed description about CRM unit will be further illustrated inchapter 3.

In FIGS. 4 a and 4 b, detailed database attributes for user information(152) is illustrated.

2. A Method and Facility for 3D Face Model Generation

FIG. 5 is detail diagram for the 3D face model generation operative(110) in FIG. 2.

FIG. 6 to FIG. 8 illustrates additional method for 3D face modelgeneration.

From here, a term ‘avatar’ is used to represent a 3D face model that hasbeen generated from photo images of human face. This term covers a 3Dface model of a user and default models stored in the database of thesystem (10).

2-1 3D Face Model Generation Facility

The 3D face model generation operative (14) provides a facility thatretrieves image information for 3D model generation and generates a 3Davatar of the user. This operative consists of facial feature extractionoperative (200), face deformation operative (206), facial expressionoperative (208), face composition operative (210), face texturegeneration operative (212), real-time preview operative (214) and filemanaging operative (216) as shown in FIG. 4.

The facial feature extraction operative (200) performs extraction offace outline profile, eyes, nose, ears, eyebrows and characteristic partof the face from facial image provided by the user. This operative isconsists of face profile extraction operative (202) and facial featurepoints extraction operative (204). In this paper, face profile pointsand facial feature points are named as ‘base points’.

The 3D face model generation unit (114) display facial images of a userand retrieve positions of the base points of front and side image byuser interaction to generate a 3D face model. Base points are a part ofthe feature points that govern characteristics of a human face to beretrieved by user interaction. This is typically done by mouse click onbase points over retrieved image. The face deformation operative (206)deforms a base 3D face model using the base points positions defined.

The Facial expression operative (208) generates facial expressions ofthe 3D face model to construct a so-called ‘talking head’ model thatsimulate the expression of human talking and gestures. The facecomposition operative (210) generates additional avatars by combining 3Dface models of the user with that of others.

The face texture generation operative (212) creates textures for the 3Dface model. This operative also creates textures for remaining part ofthe head model that are unseen in the photo images provided by the user.

The real-time preview operative (214) provides a facility that user can3D images of face model generated. The user can rotate, move, zoom inand out, and animate the 3D model at-real time. The file managingoperative (216) then saves and translates 3D avatar to generic andstandard formats to be applied in future process.

The face profile extraction operative (202) extracts outline profile ofthe face from retrieved positions of the base points. The facial featurepoints extraction operative (204) extract feature points of the facethat are inside of outline profile.

2-2 3D Face Model Generation Method

In FIG. 7 the base points for facial feature that are setup in defaultpositions of the generic face model are illustrated. As the user locatethe new positions of base points close to corresponding points of theretrieved image, the system calculate to extract precise position oftranslated based points from the retrieved image. FIG. 8 shows thefeature extraction process by that some of base points have beenadjusted to new positions. In FIG. 9, all base points have been adjustedby subsequent process.

From here, detailed mathematical process to extract feature points ofthe human face from the photo image is described.

Extracting the outline profile of the face (202) is described first. Theoutline profile of the face stands for a borderline that governscharacteristics of a human face. In the face profile extractionoperative (202), in order to extract the outline profile, an enhancedsnake that added facial texture information on a deformable base snakehas been incorporated. The mathematical definition of the snake is agroup of points that move toward the direction where the energy, such aslight intensity, minimizes from the initial positions.

Preceding snake models had limitations to extract a smooth curve ofoutline face profile because those models only allowed to move thepoints toward minimized energy without considering lighting effects. Anew snake presented in this invention implemented a new method thatconsiders texture conditions of the facial image and drives the snake tomove to where the facial textures are located, namely from outward toinward.

The face profile extraction operative (202) generates the base snakeusing the base points (Pr) and Bezier curves. The Bezier curve is amathematical curve to represent an arbitrary shape. An outline profileof the face is constructed by following Bezier curve. $\begin{matrix}{{Q(t)} = {{\sum\limits_{r = 0}^{3}{\begin{pmatrix}3 \\r\end{pmatrix}{t^{r}\left( {1 - t} \right)}^{3 - r}P_{r}}}\quad = {{\left( {1 - t} \right)^{3}P_{0}} + {3{t\left( {1 - t} \right)}^{2}P_{1}} + {3{t^{2}\left( {1 - t} \right)}P_{2}} + {t^{3}P_{3}}}}} & \left\lbrack {{Equation}\quad 1} \right\rbrack\end{matrix}$

Where, r is the number of base points and t is the constant value withrange of 0≦t≦1.

The snake defined by above equation is adjusted by following equation byfinding the direction where the energy is minimized.E=ΣαE _(int) +βE _(ext)=Σα|ν_(i)−ν_(i−1)|+β(−∇|I(x,y)|)  [Equation 2]

Where, E_(int) is internal energy meaning background color, E_(ext) isexternal energy meaning facial color of texture, α and β are arbitraryconstant value, ν is a initial point of the snake, I(x, y) is intensityat point (x, y), ∇I(x, y) is a intensity gradient at point (x, y).

Secondly, an operative to extract facial feature points (204) insideoutline profile is described. This operative utilizes a templatematching technology that finds the new positions of facial featurepoints by computing correlation in between predefined template of thefacial image and that of retrieved one. In this method, whenever theuser defines a new position, the operative trace the information in theneighbor and find adjusted point. FIG. 10 is the flow of the templatematching method.

FIG. 6 a to FIG. 6 d show predefined windows of template for facialfeature implemented in this invention is presented.

FIG. 11 to FIG. 14 illustrate a client version of the 3D face generationoperative (114) implemented on internet platforms. With this facilitythe user can generate his or her 3D avatar with one or two images of theface. This facility also can be ported on stand-alone platforms foroffline business.

FIG. 11 is the initial screen of the facility. In this screen, astep-by-step introduction for 3D avatar generation is introduced.

FIG. 12 is the step to input the just one user image. In this step,guidelines for uploading optimal image are illustrated.

FIG. 13 shows uploaded image by the user.

FIG. 14 a to FIG. 14 c show the step to adjust uploaded image byresizing, rotating and aligning. As shown in FIG. 14 d, symmetry of theface has been applied to minimize user interaction.

FIG. 14 d shows the step to define feature points of the face by mousepointer. During this step, as the user defines the points for basefeature points in the half part of the face, the operative automaticallyfind corresponding feature points in the remaining part of the face. Inaddition, as soon as the user defines a position for base featurepoints, the operative reposition remaining feature points, and promptadjusted default positions for remaining points.

FIG. 14 e shows the result of feature point extraction.

FIG. 14 f shows the each step to adjust the feature points by usingsymmetry of the face. In FIG. 14 f, ‘active points’ represent livepoints to move during the step and ‘displayed as’ represent the acquiredpoints from active step. These steps go through the pupil, eyebrow,nose, lips, ear, jaw, chin, scalp, and outline points. As soon as eachstep is finished, the next step is automatically calculated.

FIG. 15 illustrates an example of the real-time preview operative (214)implemented on the internet platform to visualize the 3D avatargenerated by 3D face generation operative (114). This operative providesfollowing facilities.

-   -   a) Built-in 3D eyeglasses models (700): Upon selection of each        eyeglasses model, virtual-try-on and automatic fitting is        performed at real-time    -   b) Product information display (705): Detailed product        description is displayed in text retrieved from product        information database (154)    -   c) Built-in 3D hair models (710): Number of hair models for male        and female are maintained by 3D model database (156). Upon        selection of each hair model, automatic fitting of the hair and        face model is performed at real-time.    -   d) Built-in texture library for hair models (715): Textures for        hair color are provided. Selected hairstyle and color together        with the face model is saved as an avatar of the user.    -   e) Showing and hiding the 3D face model (725)    -   f) Saving generated 3D avatar with a name. This avatar can be        retrieved in the applications where 3D eyeglasses simulation        system (10) is implemented.    -   g) 3D view manipulation (730): 3D models are viewed in        predefined view angles and scales for optimal visualization.        This is actually prescribed animation of 3D models to locate on        the specific position with specific angle. In addition, as the        user moves the mouse pointer over the screen, the models can be        rotated, moved and zoomed.

FIG. 16 a illustrates an example of 3D eyeglasses simulation system (10)applied on a web browser. A user can get connected to this applicationservice by having an access to internet environment provided by internetservice providers (70). This application is served from the web site ofa manufacturer or a distributor, or from online shopping malls that havepartnership with the manufacturer or the distributor. This applicationprovides following facilities.

-   -   a) Built-in sample avatars (740): Upon locating mouse pointer        over the icon, number of sample avatars that include different        genders, races, ages and types of the face are displayed. The        user can perform virtual-try-on with these avatars without        having to generate his or her own 3D avatar.    -   b) Showing and hiding the 3D face model (745)    -   c) Showing and hiding the 3D eyeglasses model (750)    -   d) Prescribed animation from different angles (755)    -   e) Link to 3D face model generation operative (760): Upon        selection of this link, 3D face generation and real-time preview        operatives illustrated in FIG. 15 are uploaded.    -   f) Selecting predefined avatar (765): For the user who has        registered in the applications where the 3D eyeglasses        simulation (10) is implemented, predefined avatars are        displayed. The user can select any of listed avatars and proceed        to virtual-try-on process.    -   g) Link to a different page of the application

The 3D avatar applications illustrated in FIG. 15 and FIG. 16 a can beextended to other applications that utilize the virtual human model.FIG. 16 b illustrates an application for virtual fashion simulationutilizing 3D avatar generated in the present invention. In this example,the 3D avatar is combined with a body model to represent a whole body ofa human. With this avatar, not only eyeglasses, but also variety offashion items such as clothing, hairstyle, jewelry and other accessoriesis simulated in similar manner.

From here, detailed mathematical process for the deformation of 3D facemodel (206) is described.

The face deformation operative (206) implemented two methods for facedeformation as follows. First method is the ‘DFFD’ (Dirichlet Free-FormDeformation) technology to determine overall size and characteristics ofa human face. Second method is to use a ‘moving factor’ driven in thepresent invention for precise control of detailed features of a humanface.

Firstly, DFFD is an extended formula of FFD (Free-Form Deformation)method. In FFD method, base points should be located on rectangularlattice. In DFFD method, there is no such limitation and arbitrarypoints can be used as base points. Thus, DFFD can use any points on theface model for base points for facial feature.

In DFFD method, assuming P as set of all base points and P₀ as set ofall points on the face, Sibson coordinate for group of points (Q_(k)) iscalculated, where Q_(k) is the neighbors of p in P for all points p inP₀. An arbitrary point p is calculated by linear combination ofneighbors p_(i) contributing to p. That is, an arbitrary point p isobtained by a linear summation of several points on featured shape. Forexample, let P₁, P₂, P₃, P₄ are arbitrary points in the convex hull ofgiven points, p surrounded by P₁, P₂, P₃, P₄ can be defined asp=u₁P₁+u₂P₂+u₃P₃+u₄P₄, where u_(i) is called Sibson coordinate of P₁,P₂, P₃, P₄ and defined as follow. $\begin{matrix}{p = {\sum\limits_{i = 0}^{n}{u_{i}P_{i}}}} & \left\lbrack {{Equation}\quad 3} \right\rbrack\end{matrix}$where, ${{\sum\limits_{i = 0}^{n}u_{i}} = 1},$and u_(i)>0 for any i in [0,n].

If one of the neighbors set Q_(k) are moved by user, amount of movement,Δp₀ is obtained by following equation. $\begin{matrix}{{\Delta\quad p_{0}} = {\sum\limits_{t = 0}^{k}{\Delta\quad P_{i}u_{i}}}} & \left\lbrack {{Equation}\quad 4} \right\rbrack\end{matrix}$where, k is the number of neighbors, ΔP_(i) is the amount of base pointmoved. Thus, new position of p₀ is calculated by p₀′=p₀+Δp₀.

Secondly, a moving factor method developed in the present invention isdescribed. In this method, when an arbitrary point p∈P moves by Δp,other points p₀∈P₀, analogous to p, move with a moving factor σ. Themoving factor σ is a constant value defined in a base point and otherpoints that are analogous to the base point. Since p₀'s movement issimilar to that of p, the movement of the p₀ is obtained by σ·Δp.Likewise, once the moving factor is determined, new positions of all ofthe base points that are analogues can be computed.

With the technology described in this chapter, a realistic 3D face modelis obtained by one or two photo images of a human face.

The facial expression operative (208) deforms 3D mesh of the face modelto represent detailed expression of human face. This operative alsodeforms corresponding texture map to get a realistic expression.

A term ‘polygon’ means a three dimensional polygonal object used inthree dimensional computer graphics. The more polygons are used, thehigher quality of 3D image is obtained. Since a polygon is a geometricalentity, there is no information for color or texture in this entity. Byapplying texture mapping to a polygon, more realistic 3D model isobtained.

To deform a polygonal model of the 3D face to generate a facialexpression, a light intensity (I) is to be calculated as shown infollowing equation for arbitrary point p on the polygon of the facemodel by Rambert model. $\begin{matrix}{I = {\rho\quad{\sum\limits_{i = 1}^{m}{I_{i}{n \cdot l_{i}}}}}} & \left\lbrack {{Equation}\quad 5} \right\rbrack\end{matrix}$where, ρ is a reflection coefficient, I₁ is a light intensity, l_(i) isa direction to light source, m is the number of spot light and n is thenormal vector at point p.

Then, the light intensity (I′) for updated polygon is obtained byfollowing equation. $\begin{matrix}{I^{\prime} = {\rho\quad{\sum\limits_{i = 1}^{m}{I_{i}{n^{\prime} \cdot l_{i}^{\prime}}}}}} & \left\lbrack {{Equation}\quad 6} \right\rbrack\end{matrix}$where, n′ and l_(l)′ is normal vector and light intensity respectivelyon updated polygon.

From equation 5 and equation 6, ERI (Expression Ratio Intensity) of thesurface of the face is obtained by following equation. $\begin{matrix}{R = {\frac{I^{\prime}}{I} = \frac{\sum\limits_{i = 1}^{m}{I_{i}{n^{\prime} \cdot l_{i}^{\prime}}}}{\sum\limits_{i = 1}^{m}{I_{i}{n \cdot l_{i}}}}}} & \left\lbrack {{Equation}\quad 7} \right\rbrack\end{matrix}$where, R is the ERI value of the surface of 3D face model.

The ERI value obtained by above procedure is applied to warp polygons ofunexpressed facial model to generate a facial expression.

The face composition operative (210) is generates a new avatar from thegenerated 3D face model by using the face composition process. Given anarbitrary face data F_(i)={F_(i0), F_(i1), . . . , F_(in)} andF_(j)={F_(j0), F_(j1), . . . , F_(jn)} have a same polygon structure,corresponding feature points jmfor specific point im = ( x im , ⁢ y im , z im , r im , g im , b im ∈ F iexist. A new face model F′ is obtained by combining the face F_(i) andF_(j), namely F′=αF_(i)+βF_(j) where, α and β is the ratio for facialsimilarity and (α+β=1).

The face texture generation operative (212) generates Cartesiancoordinates of the 3D face model and generates texture coordinates ofthe front and side image of the face. This operative extracts a borderof two images and projects the border onto the front and side views togenerate textures near the border, and blend textures from two views byreferencing acquired texture on the border. Besides, this operativegenerate remaining texture of head model that is unseen by the photoimages provided by the user.

3. Intelligent CRM (Customer Relation Management) Unit

In FIG. 17, a schematic diagram for the intelligent CRM unit implementedin 3D eyeglasses simulation system (10) is illustrated.

As shown in the figure, CRM unit (140 is consist of a product preferenceanalysis operative (322), a customer behavior analysis operative (324),an artificial intelligent learning operative (326), a fashion advisegeneration operative (328), an 1:1 marketing data generation operative(330), an 1:1 marketing data delivery operative (332), a log analysisdatabase (340) and a knowledge base for fashion advise (342).

The operative for product preference (322) analyzes the demographicinformation of a user, such as age, gender, profession and race, andenvironmental information, such as the name of internet serviceprovider, connection speed and type of telecommunication device, for acertain type or category of eyeglasses product. This result constructs araw data for knowledge base incorporated in the system (10).

The operative for analysis of customer behavior (324) analyzes thecharacteristics of a user's action on commerce contents collected formlog analysis database (340), and to store the analysis result onknowledge base (342). The log analysis database (340) collects widerange of information about the user behavior such as online connectionpath, click rate on a page or a product, site traffic and response topromotion campaign.

The operative for artificial intelligent learning (326) integratesanalysis for product preference and customer behavior with fashion trendinformation provided by experts in fashion, and construct raw data foradvising service dedicated to a customer.

The 1:1 marketing operative consists of the 1:1 marketing datageneration operative (330) to acquire and manage demographic informationof the user including email address or phone numbers and to publishpromotional contents using 3D simulative features and the 1:1 marketingdata delivery operative (332) to deliver promotional contents to themultiple telecommunication form factors of the customer. The promotionalcontents are published in proper data formats, such as image, web3D,VRML, Flash, animation or similar rich media contents formats, to beloaded on different types of communication devices.

Above marketing operative (330, 332) keep track of customer response andrecord it in log analysis database (340). This response are forwarded tothe operatives for product preference (322) and customer behavioranalysis (324) to generate analysis on response history of productpreference, seasonal effect, promotion media, campaign management, priceand etc. Analyzed result is provided to the manufacturer or the sellerand applied as base information to design future product to setup salesstrategy. In FIG. 18 a and FIG. 18 b, examples of 1:1 marketing areillustrated.

In order to publish 1:1 marketing contents, a face model of the user isrequired. This model is obtained by following cases. Firstly, a user canupload his or her own image onto the online applications where 3Deyeglass simulation system (10) is implemented. Secondly, an optician ora seller take a photograph of the user when he or she visited offlineshow room and register the image on customer's behalf. Uploaded imagesacquired above sequence is stored and maintained in 3D simulationapplication server.

By running CRM analysis in early stage of production cycle throughcommunication with potential customers, a manufacturer or a seller canimprove customer satisfaction by incorporating the response acquiredfrom the analysis. This process optimizes production and distributionprocess of eyeglasses. The information generated during this process canbe utilized as decision support material on B2C or B2B business ofeyeglasses complemented by electronic catalogue or similar 3Dvirtual-try-on contents published in 1:1 marketing process.

The operatives illustrated in this chapter are managed by the CRM unit(140) in FIG. 17 and FIG. 2.

The CRM unit (140) can provide quantified data for future forecast ofproduct sales and trend, and can provide advice to a customer dedicatedto his or her own preference by extensive analysis on response analysis.This unit also provides contents for custom-made eyeglasses withdedicated assistance for fashion trend and the characteristics of theuser profile.

The parameters that govern tendency and preference on a product can besummarized as below. TABLE 1 Demographic parameters for CRM unitParameters for an Avatar Parameters for a Customer Shape of the faceRace Width and length of the face Age Skin tone Gender Lighting for theface Visual power PD in 3D model Address, Country Mouth size ProfessionLocation of the Eyebrow Actual PD Hair style Purchase preference Colorof the hair Preference setup

Above parameters are used to obtain following object functions toevaluate customer preference on eyeglasses products. TABLE 2 Objectfunctions for product preference analysis Arguments Analysis objectsSize of eyeglasses Seasonal effect Shape of eyeglasses Campaign effectBrand/Manufacturer Geographical effect Distributor/Seller Design trendMaterials Purchase trend Color/Pattern for frame Preference by facewidth/shape Colon/Pattern for lenses Preference by race/gender Countryof origin Preference by profession Price Preference by hair style Modelyear Preference by pricing4. A Method and System for 3-Dimensional Modeling of Eyeglasses

FIG. 19 shows the diagram for the operative to manage 3D eyeglassesmodel and FIG. 20 is the flow chart for automatic fitting of 3Deyeglasses and 3D face model.

As shown in FIG. 19, the operative to manage 3D eyeglasses modelprovides a facility to try 3D eyeglasses model virtually on thegenerated 3D face model and to simulate designs of the eyeglassesproduct comprises automatic eyeglasses model fitting operative (240),hair fitting operative (241), face model control operative (242), haircontrol operative (243), eyeglasses modeling operative (244), texturecontrol operative (246), animation operative (248) and real-timerendering operative (250).

The automatic eyeglasses model fitting operative (240) fits the modelgenerated from 3D face model generation operative (14) with 3Deyeglasses model, and its detailed flow is illustrated in FIG. 20 thatshows the flow chart for automatic fitting of 3D eyeglasses and 3D facemodel.

The automatic eyeglasses model fitting operative (240) uses coordinatesof the three points on the 3D mesh of eyeglasses and face as inputrespectively with parameters for automatic fitting. These parameters areused to deform 3D eyeglasses model for virtual-try-on. The fittingprocess is performed by following procedure. Firstly, the operativecalculates scales and positions with parameters of 3D eyeglasses andcorresponding parameters of the 3D face model (S600). Secondly,reposition the 3D eyeglasses model by transforming Y and Z coordinatesof the model (S602,S604). Finally, rotate the 3D eyeglasses model in X-Zand Y-Z plane to place the temple part of the model to hang on to theear part of the 3D face model.

4-1 A device for 3D Reverse Modeling of Eyeglasses

For realistic simulation for 3D eyeglasses, precise modeling of theeyeglasses is very important. In the present invention, a systematicreverse modeling operative that consists of dedicated software foreyeglasses modeling and a specially designed measuring device isdeveloped. With this modeling system, a precise model is generated byduplicating the sequence of eyeglass design. 3D eyeglasses modelgenerated by this method has of great value because vast majorityeyeglasses products do not have such information in digital format.Therefore, the developed measuring device provides a systematicprocedure to enable reverse modeling method. This procedure isillustrated in FIG. 21 and FIG. 27.

Reverse modeling procedure consists of following five steps.

1) Generating Images Using a Measuring Device:

The measuring device is made out of a transparent acryl box where rulersare carved in horizontal and vertical direction as shown in FIG. 21.Placing eyeglasses inside the box, photographic images are taken fromthe front and side view with the measurement for real dimensions ofeyeglasses. Top cover can be elevated upward and downward, so that ithelps to take image in precise dimension. Photographic images taken fromthe measuring device are imported to reverse modeler as shown in FIG. 22a and FIG. 22 b.

As shown in FIG. 22 b, photographic images with lattice in it preservesdimension for eyeglasses reverse modeling. Photographic image and realdimension data acquired from the device are inputted to 3D eyeglassesmodel generation operative (244) shown in FIG. 19, by that shape andtexture eyeglasses is generated as shown in FIG. 27. FIG. 27 is an imageof 3D eyeglasses model, generated by the operative as shown in FIG. 22 aand FIG. 22 b, retrieved from general-purpose 3D modeling software. Themodel generated in above procedure is refined with remaining partsselected from built-in library of 3D models and adjusted by providedparameters for each component.

3D reverse modeling operative stores measured information, connectscompleted 3D eyeglasses model to the database of 3D eyeglassessimulation system, and maintain its information upon each update of thesystem. FIG. 22 f shows overall flow for reverse modeling process.

2) Generating Lens Parts:

In general, surface powers of typical lens ranges from 0 to 10, majorityof the products in the market are any of 6, 8, or 10. These are simplycalled ‘Curve 6’, ‘Curve 8’ and ‘Curve 10’. The higher the curve numberis, the smaller the radius of the curvature is. High curved model istypically used for goggle type of eyeglasses. Lens curve is known fromthe specification of eyeglasses.

Assuming only commercial products are to be modeled, the curve number ofthe lens can be decided by choosing discrete numbers between 6 to 10.Based on photograph information acquired from measuring device andspecification of the lens, the curvature of the lens can be easilyobtained. For normal prescription spectacles, the lens curve does not goover curve 6. The radii of the curvature for a specific curve numberdiffer by the optical property of the lens. This property is a constantvalue that depends on the material of the lens. Optical property withrespect to different types of material is known as industry standard.For instance, the radius of curvature for a curve 6 lens with CR-39plastic is 83.0 mm.

When the radius of the curvature is decided, a sphere is made to startmodeling of the lens. Firstly, a lens curve corresponding ED valueshould be created, where ED is the distance between far end parts of thelens. Creating a circle according to the ED value and project ithorizontally to the sphere that is already made will complete lens curvegeneration as shown in FIG. 22 c. Secondly, from the projected sphere, apart for lens curve is extracted by trimming. Thirdly, duplicate thesurface using the front view image and modifying the shape by creatinganother circle vertically as shown in FIG. 22 d. Using the circleextracted from lens shape, lens model is finally generated by projectingthe circle horizontally to the lens curve and trimming it as shown inFIG. 22 e. Normally thickness of the lens is about 1˜2 mm, so thethickness is assumed to be in such range in the modeling.

As an alternative to above procedure, an extensive library of lens modelwith respect to different curvature is provided by built-in library. Byadjusting parameters to match acquired dimension from the measuringdevice, lens modeling can be readily performed. This technique isefficient for regular spectacles, while previous technique is efficientfor complex models.

Once the lens shape is generated, it is rotated by average of 6 degreesdownwards to have a parallel slope with anthropometrical structure ofhuman's eye. From the top view, it can be seen that the lens of theeyeglasses is rotated in Y-direction. Therefore, lens should be rotatedby 6 degrees in X and Y-direction appropriate to the actual eyeglasses.For Y-direction, rotation differs from model to model by its nature ofthe design. Value of Y-direction for common prescription eyeglasses islimited approximately to 10 degrees while fashion eyeglasses orsunglasses are to 15˜25 degrees. Once lens generation is completed thisstep will form a basis to create the frame model.

3) Generating Rim and Bridge Parts:

As the frame has the same radius of curvature as that of lens, itscurvature is predetermined. First step of frame modeling is to generatea rim that surrounds the lens as shown in FIG. 23 a. For rimlesseyeglasses, this step is not necessary. The thickness of the frame inthe rim can be easily obtained by choosing industry standard values orby measuring devices.

As in lens modeling, an extensive library of rim model with respect todifferent curvature is provided by built-in library with parameters toadjust the models to match the image acquired from the measuring device.

By its nature of symmetry in a frame with respect to center ofeyeglasses, remaining models for the other lens and rim is generated bymirroring the model created in previous process as shown in FIG. 23 b.The distance between a pair of lenses is obtained from sizespecification of eyeglasses.

Rest of the process is to connect a pair of lenses by a bridge model.Since the bridge is not designed for optical purpose, its shape isdesigned by artistic perspective as shown in FIG. 23 c. Consequently, abuilt-in library of 3D model for the bridge part is provide to be usedas a template for the specific bridge model that connects generated apair of lens and the frame part.

4) Generation a Temple Part:

As a temple was designed to fit average size of human head, its lengthand curvature are also predetermined as industry standards. By using themeasuring device or choosing typical discrete design value, thickness ofthe temple is obtained. Meanwhile, there are some models that havelongitudinal curves along the length of the temple. By analyzing thecoordinates of grid points acquired from the measuring device, thiscurve is to be obtained as shown in FIG. 25 a and FIG. 25 b.

Once a temple model is done, the remaining temple is generated bymirroring the model created in above process. This process is identicalto process to generate a pair of lens model. This procedure isillustrated in FIG. 26. As in lens and rim modeling, a library of templemodel is provided by built-in library with parameters to adjust themodels to match the image acquired from the measuring device.

5) Completing Eyeglasses Model:

Remaining parts of eyeglasses model such as nose pads, hinges and screwsare done by selecting 3D model components from built-in library as shownin FIG. 24 a, FIG. 24 b and FIG. 24 c. Modeling data for those parts canalso be retrieved by importing 3D models generated by general-purposesoftware.

Once modeling job is finished, its data can be exported to differenttypes of standard 3D data format, such ‘.obj’, ‘.3ds’, ‘.igs’ and‘.wrl’. Relevant drawing can also be generated by projecting the 3Dmodel onto 2D plane.

4-2. Extraction of Fitting Parameters for 3D Face Model

The face model control operative (242) manages fitting parameters in 3Dface model.

1) Preferred Embodiment

As shown in FIG. 28, fitting parameters of the 3D face model includereference points for the gap distance (A) between the eyes and lenses,and for the hinge (B) in eyeglass and contact point on ears (C). Thereference point for gap distance (A) is the vertical top point ofeyebrow. The reference point (B) for hinge is on the outer corner of theeyes and outer line of front side face as shown in FIG. 28. Thereference point C is contact point on ears is that matches that of atemple.

2) Another Preferred Embodiment

As shown in FIG. 37, the face model control operative (242) implementedanother method to fit the 3D eyeglasses model on the 3D face model. Thismethod utilizes following fitting parameters.

-   -   a) NF: the center point of the 3D face model    -   b) CF: the center top of the ear part of the 3D face model that        contacts the temple part of the 3D eyeglasses model during        virtual-try-on    -   c) DF: the point at the top of the scalp        4-3. Extraction of Fitting Parameters for 3D Eyeglasses Model

As in fitting parameters for 3D face model, two different methods areimplemented.

1) Preferred Embodiment

FIG. 29 shows the fitting parameters of 3D eyeglasses model utilized inthe eyeglasses modeling operative (244). Fitting points A′, B′ and C′are the points that correspond to that of A, B and C in the 3D facemodel.

2) Another Preferred Embodiment

FIG. 38 shows another the fitting parameters for 3D eyeglasses model.The fitting parameters of this method are corresponds to the secondfitting parameters of the 3D face model described above. The fittingparameters of eyeglasses are as follows.

-   -   a) NG: the center of the nose part of said 3D face model that        contacts the nose pad part of the 3D eyeglasses model during        virtual-try-on    -   b) HG: the rotational center of hinge part of the 3D eyeglasses        model    -   c) CG: the center of inner side of the temple part of the 3D        eyeglasses model that contact said ear part of the 3D face model        4-4. Extraction of Fitting Parameters for 3D Hair Model

FIG. 41 illustrates the flow of the automatic fitting of 3D hair models.The hair control operative (243) selects a hair model from database(S640) and fits the hair size and position automatically over the 3Dface model (S644)(S648). The hair model is moved to proper position byusing the difference of the fitting point DF in the face model in FIG.37 and DH in the hair model in FIG. 39.

4-5. Process to Fit 3D Eyeglasses and 3D Face Model

FIG. 37 to FIG. 40 illustrates an automatic fitting process for 3Dvirtual-try-on of eyeglasses with a 3D face model. The overall processof this operative is illustrated in FIG. 42. This is a fully automaticprocess performed at-real time and the user does not have to do anyfurther interaction to adjust the 3D eyeglasses model. This methodutilizes a pupillary distance of the user and a virtual pupillarydistance acquired by user interaction in the 3D face generationoperative. If the user does not know his or her pupillary distancevalue, an average value of pupillary distance is setup depending ondemographic characteristics of the user. Detailed fitting process is asfollows.

-   -   1) As shown in FIG. 37, obtain the coordinates fitting points        NF, CF and DF for the 3D face model generated in the face model        control operative (242).    -   2) Fit the 3D hair model to 3D face model using the fitting        points Df following the process illustrated in FIG. 41. The        operative adjusts the scale of the hair model (S640) and adjust        the location (S644)    -   3) As shown in FIG. 38, obtain the fitting points, NG, HG and CG        for the 3D eyeglasses model    -   4) Calculate for scale, rotation and movement of 3D eyeglasses        to adjust using fitting parameters described above following        formula.

The scale factor that scales the size of 3D eyeglasses model forautomatic fitting is represented by:SF=X _(B) /X _(B)′,g=SF·G

Where, SF is the scale factor, X_(B)′ is the X-coordinate of the fittingpoint B′ for the hinge part of 3D eyeglasses model and X_(B) is theX-coordinate of the corresponding fitting point B for the 3D face model,G is the size of original 3D eyeglasses model and g is a scaled size ofthe model in X-direction.

The movement in Y-direction to close the gap between the fitting point Bfor 3D face model and the scaled fitting point b′ by said scale factorfor the hinge part of 3D eyeglasses model is represented by:$\begin{matrix}{{\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}} \\{b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}\end{matrix}$

Where, ΔY is the movement of 3D eyeglasses model in Y-direction,(X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fitting point B′ forthe hinge part of the 3D eyeglasses model, (X_(B), Y_(B), Z_(B)) are thecoordinates of the corresponding fitting point B for the 3D face modeland Y_(b′) is the Y-coordinate of the scaled fitting point b′.

The movement in Z-direction to close the gap between the fitting point Afor 3D face model and the scaled fitting point a′ by said scale factorfor the hinge part of 3D eyeglasses model is represented by:$\begin{matrix}{{\Delta\quad Z} = {{\left( {Z_{A} + \alpha} \right) - Z_{a^{\prime}}} = {Z_{A} + \alpha - {Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}} \\{a^{\prime} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}\end{matrix}$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point a′ and α is the relative distance between thetop centers of the lens and the eyebrow.

The rotation angle θ_(y) in X-Z plane with respect to Y-axis representedby the angle calculated from cosine function is represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z)

-   -   where, C is the fitting point for the vertical top point in the        ear of the 3D face model that contacts with temple part of the        3D eyeglasses model, C′ is the corresponding fitting point for        the temple part of the 3D eyeglasses model and B′ is the fitting        point for the hinge part of the 3D eyeglasses.

The rotation angle θ_(x) in Y-Z plane with respect to X-axis representedby the angle calculated from cosine function is represented by:Cos θ_(x)=Cos(∠CB′C′)_(Y-Z)where, C is the fitting point for the vertical top point in the ear ofthe 3D face model that contacts with temple part of the 3D eyeglassesmodel, C′ is the corresponding fitting point for the temple part of the3D eyeglasses model and B′ is the fitting point for the hinge part ofthe 3D eyeglasses.

FIG. 36 illustrates the final result of automatic fitting utilizingabove method.

FIG. 44 illustrates the flow of the avatar service flow over theinternet platforms.

FIG. 45 illustrates the overall flow of the eyeglasses simulation

1. A virtual simulation system connected to a computer network togenerate a 3D face model of a user, and to fit the face model and 3Deyeglasses models selected by the user, and to simulate them graphicallywith a database that stores the information of users, products, 3Dmodels and knowledge base comprising: a user data processing unit toidentify the user who needs to have an access to simulation system, andto generate a 3D face model of the user; a graphic simulation unit wherea user can visualize 3D eyeglasses model that is generated as the userselects a product in the database, and to place and to fit automaticallyin 3D space on user's face model created in user data processing module;an intelligent CRM (Customer Relation Management) unit that can advisethe user by a knowledge base that provides consulting informationacquired by knowledge of fashion expert, purchase history and customerbehavior on various products.
 2. A system for 3D simulation ofeyeglasses according to claim 1, wherein the user data processing unitcomprises: A user information management operative to identifyauthorized user who have a legal access to the system and to maintainuser information at each transaction with database; A 3D face modelgeneration operative to create a 3D face model of a user by theinformation retrieved by the user.
 3. A system for 3D simulation ofeyeglasses according to claim 2, wherein the 3D face model generationoperative comprises a data acquisition operative to generate a 3D facemodel of a user: by a image capturing device connected to a computer; orby retrieving front or front-and-side view of photo images of the face;or by manipulating 3D face model stored in the database of 3D eyeglassessimulation system.
 4. A system for 3D simulation of eyeglasses accordingto claim 2, wherein the 3D face model generation operative comprises afacial feature extraction operative to generate feature points of a base3D model as a user input a outline profile and feature points of theface on a device that displays acquired photo images of the face, and togenerate a base 3D model.
 5. A system for 3D simulation of eyeglassesaccording to claim 2, wherein the 3D face model generation operativefurther comprises a 3D face model deformation operative to retrieveprecise coordinates points by user interaction, and to deform a base 3Dmodel by relative displacement of reference points from default locationby calculated movement of feature points and other points in thevicinity.
 6. A system for 3D simulation of eyeglasses according to claim4, wherein the feature points of a face comprises predefined referencepoints on outline profile, eyes, nose, mouth and ears of a face.
 7. Asystem for 3D simulation of eyeglasses according to claim 4, wherein thefacial feature extraction operative comprises: a face profile extractionoperative to extract outline profile of 3D face model from the referencepoints input by the user; a facial feature points extraction operativeto extract feature points that characterize the face of the user fromthe reference points on of eyes, nose, mouth and ears input by the user8. A system for 3D simulation of eyeglasses according to claim 4,wherein the 3D face model generation operative further comprises afacial expression operative to deform a 3D face model at-real time togenerate human expressions under user's control.
 9. A system for 3Dsimulation of eyeglasses according to claim 4, wherein the 3D face modelgeneration operative further comprises a face composition operative tocreate a new virtual model by combining a 3D face model of a usergenerated by the face model deformation operative with that of theothers.
 10. A system for 3D simulation of eyeglasses according to claim4, wherein the 3D face model generation operative further comprises aface texture generation operative: to retrieve texture information fromphoto images provided by a user; to combine textures acquired from frontand side view of the photo images; to generate textures for the unseenpart of head and face on the photo images.
 11. A system for 3Dsimulation of eyeglasses according to claim 4, wherein the 3D face modelgeneration operative further comprises a real-time preview operative todisplay 3D face and eyeglasses models with texture over the network, andto display deformation process of the models.
 12. A system for 3Dsimulation of eyeglasses according to claim 4, wherein the 3D face modelgeneration operative further comprises a file managing operative tocreate and save 3D face model in proprietary format and to convert 3Dface model data into industry standard formats.
 13. A system for 3Dsimulation of eyeglasses according to claim 1, wherein the graphicsimulation unit comprises: a 3D eyeglasses model management operative toretrieve and store 3D model information on the database by userinteraction; a texture generation operative to create colors and texturepattern of 3D eyeglasses models, and to store the data in the database,and to display textures of 3D models on a monitor generated in user dataprocessing unit and eyeglasses modeling operative; a virtual-try-onoperative to place 3D eyeglasses and face model in 3D space and todisplay.
 14. A system for 3D simulation of eyeglasses according to claim13, wherein a 3D eyeglasses model management operative comprise: aneyeglasses modeling operative to create a 3D model and texture ofeyeglasses and to generate fitting parameters for virtual-try-on thatinclude reference points for the gap distance between the eyes andlenses, hinges in eyeglasses and contact points on ears; a face modelcontrol operative to match fitting parameters generated in eyeglassesmodeling operative.
 15. A system for 3D simulation of eyeglassesaccording to claim 13, wherein a 3D virtual-try-on operative comprises:an automatic eyeglasses model fitting operative to deform a 3Deyeglasses model to match a 3D face model automatically at real-time onprecise location by using fitting parameters upon user's selection ofeyeglasses and face model; an animation operative to display prescribedanimation scenarios to illustrate major features of eyeglasses models; areal-time rendering operative to rotate, move, pan, and zoom 3D modelsby user interaction or by prescribed series of interaction.
 16. A systemfor 3D simulation of eyeglasses according to claim 13, wherein the 3Dvirtual-try-on operative further comprises a custom-made eyeglassessimulation operative: to build user's own design by combining componentsof eyeglasses that include lenses, frames, hinges, temples and bridgesfrom built-in library of eyeglasses models and texture; to placeimported images of user's name or character to a specific location tobuild user's own design: to store simulated design in user dataprocessing unit.
 17. A system for 3D simulation of eyeglasses accordingto claim 1 further comprises a commerce transaction unit to operate amerchant process so that a user can purchase the products after tryinggraphic simulation unit.
 18. A system for 3D simulation of eyeglassesaccording to claim 17, wherein the commerce transaction unit comprises:a purchase management operative to manage orders and purchase history ofa user; a delivery management operative to verify order status and toforward shipping information to delivery companies; a inventorymanagement operative to manage the status of inventory along withpayment and delivery process.
 19. A system for 3D simulation ofeyeglasses according to claim 1, wherein the intelligent CRM unitcomprises: a product preference analysis operative to analyze thepreference on individual product by demographic characteristics of auser and of a category, and to store the analysis result on knowledgebase; a customer behavior analysis operative to analyze thecharacteristics of a user's action on commerce contents, and to storethe analysis result on knowledge base; an artificial intelligentlearning operative to integrate analysis for product preference andcustomer behavior with fashion trend information provided by experts infashion, and construct raw data for advising service dedicated to acustomer; a fashion advise generation operative to create advising datafrom the knowledge base and store it to the database of 3D eyeglassessimulation system, and to deliver dedicated consulting information uponuser's demand that include design, style and fashion trend suited for aspecific user; an 1:1 marketing data generation operative to acquire andmanage demographic information of the user including email address orphone numbers and to publish promotional contents using 3D simulativefeatures; an 1:1 marketing data delivery operative to deliverpromotional contents to the multiple telecommunication form factors ofthe customer.
 20. A system for 3D simulation of eyeglasses according toclaim 19, the knowledge base comprises a database for log analysis andfor advise on fashion trend.
 21. A method for 3D simulation ofeyeglasses for a 3D eyeglasses simulation system connected to a computernetwork to generate a 3D face model of a user, and to fit the face modeland 3D eyeglasses models selected by the user, and to simulate themgraphically with a database that stores the information of users,products, 3D models and knowledge base comprising: a step to generate 3Dface model of the user as the user transmit photo images of his or herface to the 3D eyeglasses simulation system, or as the user select oneof 3D face model stored in said database; a step to generate 3Deyeglasses model that selects one of 3D models stored in said databaseand generates 3D model parameters of said eyeglasses model forsimulation; a step to simulate virtual-try-on on display monitor thatfits said 3D eyeglasses and face model by deforming eyeglasses modelat-real time, and that displays combined 3D mages of eyeglasses and facemodel at different angles.
 22. A method for 3D simulation of eyeglassesaccording to claim 21, the step to generate a 3D face model of the usercomprises: a step to display image information from the input providedby the user; a step to extract an outline profile and feature points ofsaid face as the user input base feature points on displayed imageinformation; a step to create a 3D face model by deforming base 3D modelwith a movement of base feature points observed during user interaction.23. A method for 3D simulation of eyeglasses according to claim 22, thestep to extract an outline profile and feature points of said facecomprises: a step to create a base snake as the user input base featurepoints that include facial features points along outline and featuredparts of the face; a step to define vicinity of said snake to move oneach points along the snake to vertical direction; a step to move saidsnake to the direction where color maps of the face in said imageinformation exist.
 24. A method for 3D simulation of eyeglassesaccording to claim 22, the step to extract outline profile and featurepoints of said face extract similarity between image information offeatured parts of the face input by the user and that of predefinedgeneric model.
 25. A method for 3D simulation of eyeglasses according toclaim 22, the step to create a 3D face model comprises: a step togenerate Sibson coordinates of the base feature points; a step tocalculate movement of the base feature points to that of said imageinformation; a step to calculate a new coordinates of the base featurepoints as a summation of coordinates of the default position and thecalculated movement.
 26. A method for 3D simulation of eyeglassesaccording to claim 22, the step to create a 3D face model comprises: astep to calculate movement coefficients as a function of movement of thebase feature points; a step to calculate new positions of feature pointsin the vicinity of base points by multiplying movement coefficient. 27.A method for 3D simulation of eyeglasses according to claim 22 furthercomprises a step to generate facial expressions by deforming said 3Dface model generated from said step to create a 3D face model and byusing additional information provided by the user.
 28. A method for 3Dsimulation of eyeglasses according to claim 27, the step to generatefacial expressions comprises: a step to compute the first lightintensity on the entire points over the 3D face model; a step to computethe second light intensity of the image information provided by theuser; a step to calculate the ERI (Expression Ratio Intensity) valuewith the ratio of said second light intensity over that of said second;a step to warp polygons of the face model by using the ERI value togenerate human expressions.
 29. A method for 3D simulation of eyeglassesaccording to claim 22 further comprises a step to combine photo imageinformation of the front and side view of the face, and to generatetextures of the remaining parts of the head that are unseen by saidphoto image.
 30. A method for 3D simulation of eyeglasses according toclaim 29, the generate textures of remaining parts of the headcomprises: a step to generate Cartesian coordinates of said 3D facemodel and to generate texture coordinates of the front and side image ofthe face; a step to extract a border of said two images and to projectthe border onto the front and side views to generate textures in thevicinity of the border on the front and side views; a step to blendtextures from the front and side views by referencing acquired textureon the border.
 31. A method for 3D simulation of eyeglasses according toclaim 29, before the step to generate 3D face model of the user,comprises: the first step to check whether the user's 3D face model hasbeen registered before or not; the second step to check whether the userwill update registered models or not; the third step to check whetherthe registered model has been generated by photo image provided by theuser or by built-in 3D face model library; the fourth step to load theselected model when it is generated form the information provided by theuser.
 32. A method for 3D simulation of eyeglasses according to claim 31further comprises: the fifth step to confirm whether the user willgenerate a new face model or not when a stored model does not exist; thesixth step to display built-in default models when the user does notwant to generate a new model; the seventh to create an avatar from 3Dface model generated by photo image of the user by installing dedicatedsoftware on personal computer when the software has not been installedbefore in case the user wants to generate a 3D face model; the eighthstep to register the avatar information and to proceed to the third stepto check whether the model has been registered or not.
 33. A method for3D simulation of eyeglasses according to claim 31 proceeds to theseventh step and to complete remaining process when the user wants toupdate the 3D face model in the second step.
 34. A method for 3Dsimulation of eyeglasses according to claim 31 further comprises a stepto display the last saved model that has been selected in said thirdstep.
 35. A method for 3D simulation of eyeglasses according to claim 31that checks whether the user has been registered or not as in said firststep and identifies that the user is the first visitor comprises: a stepto check whether the user select one of built-in default models or notafter providing login procedure; a step to display selected defaultmodels on the monitor; a step to check to proceed to said seventh stepif the user does not select any of built-in default model.
 36. A methodfor 3D simulation of eyeglasses according to claim 21 further comprisesa step to select a design of frame and lenses, brand, color, materialsor pattern from built-in library for the user.
 37. A method for 3Dsimulation of eyeglasses according to claim 21, the step to generate 3Deyeglasses model that selects one of 3D models stored in the databasefurther comprises a step to provide fashion advise information to theuser by intelligent CRM unit can advise the user by a knowledge basethat provides consulting information acquired by knowledge of fashionexpert, purchase history and customer behavior on various products. 38.A method for 3D simulation of eyeglasses according to claim 21, the stepto simulate on display monitor comprises: a step to scale eyeglassesmodel with respect to X-direction, that is the lateral direction of the3D face model, by referencing fitting points at eyeglasses and facemodel that consists of the distance between face and far end part ofeyeglasses, hinges in eyeglasses and contact points on ears; a step totransform coordinates of Y-direction, that is up and downward directionto the 3D face model, and Z-direction, that is front and backwarddirection to the 3D face model, with the scale calculated inX-direction; a step deform temple part of the 3D eyeglasses model tomatch corresponding fitting points between 3D face and eyeglasses model.39. A method for 3D simulation of eyeglasses according to claim 38comprises the scale factor that scales the size of 3D eyeglasses modelfor automatic fitting represented by:SF=X _(B) /X _(B)′,g=SF·G Where, SF is the scale factor, X_(B)′ is the X-coordinate of thefitting point B′ for the hinge part of 3D eyeglasses model and X_(B) isthe X-coordinate of the corresponding fitting point B for the 3D facemodel, G is the size of original 3D eyeglasses model and g is a scaledsize of the model in X-direction.
 40. A method for 3D simulation ofeyeglasses according to claim 38 comprises the movement in Y-directionto close the gap between the fitting point B for 3D face model and thescaled fitting point b′ by said scale factor for the hinge part of 3Deyeglasses model represented by: $\begin{matrix}{{\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}} \\{b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}\end{matrix}$ where, ΔY is the movement of 3D eyeglasses model inY-direction, (X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fittingpoint B′ for the hinge part of the 3D eyeglasses model, (X_(B), Y_(B),Z_(B)) are the coordinates of the corresponding fitting point B for the3D face model and Y_(b′) is the Y-coordinate of the scaled fitting pointb′
 41. A method for 3D simulation of eyeglasses according to claim 38comprises the movement in Z-direction to close the gap between thefitting point A for 3D face model and the scaled fitting point a′ bysaid scale factor for the hinge part of 3D eyeglasses model representedby: $\begin{matrix}{{\Delta\quad Z} = {{\left( {Z_{A} + \alpha} \right) - Z_{a^{\prime}}} = {Z_{A} + \alpha - {Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}} \\{a^{\prime} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}\end{matrix}$ where, ΔZ is the movement of 3D eyeglasses model inZ-direction, (X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fittingpoint A′ for the top center of a lens in the 3D eyeglasses model,(X_(A), Y_(A), Z_(A)) are the coordinates of the corresponding fittingpoint A for top center of an eyebrow in the 3D face model, Z_(a′) is theZ-coordinate of the scaled fitting point a′ and α is the relativedistance between the top centers of the lens and the eyebrow.
 42. Amethod for 3D simulation of eyeglasses according to claim 38 comprisesthe rotation angle θ_(y) in X-Z plane with respect to Y-axis representedby the angle calculated from cosine function represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 43. A method for3D simulation of eyeglasses according to claim 38 comprises the rotationangle θ_(x) in Y-Z plane with respect to X-axis represented by the anglecalculated from cosine function represented by:Cos θ_(x)=Cos(∠CB′C′)_(Y-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 44. A storagemedia to read a program to from a computer network to generate a 3D facemodel of a user, and to fit the face model and 3D eyeglasses modelsselected by the user, and to simulate them graphically with a databasethat stores the information of users, products, 3D models and knowledgebase, to execute a program comprising: an operative to generate 3D facemodel of the user as the user transmit photo images of his or her faceto the 3D eyeglasses simulation system, or as the user select one of 3Dface model stored in said database; an operative to generate 3Deyeglasses model that selects one of 3D models stored in said databaseand generates 3D model parameters of said eyeglasses model forsimulation; an operative to simulate virtual-try-on on display monitorthat fits said 3D eyeglasses and face model by transforming the Y andZ-coordinates of 3D eyeglasses model with the scale factor calculatedfrom X-direction, using the gap distance between the eyes and the lensesand the fitting points for the ear part of the face model and for thehinge and the temple part of the eyeglasses model, and that displayscombined 3D images of eyeglasses and face model at different angles. 45.A method to generate a 3D face model comprising: (a) a step to input a2D photo image of a face in front view and to display said image; (b) astep to input at least one base points, on the said image, thatcharacterizes a human face; (c) a step to extract an outline profile andfeature points for eyes, nose, mouth and ears that construct featureshapes of said face; (d) a step to convert said input image informationto a 3D face model using said outline profile and feature points.
 46. Amethod to generate a 3D face model according to claim 45, the basepoints include at least one points in the outline profile of the face,and the step (c) to extract the outline profile of the face comprises:(c1) a step to generate a base snake on said face information on saidimage referencing said base points; (c2) a step to extract the outlineprofile by moving snake of the said face to the direction where texturesof the face exist.
 47. A method to generate a 3D face model according toclaim 45, the base points include at least one points that correspond toeyes, nose, mouth and ears, and the step (c) to extract the outlineprofile of the face comprises: a step to comprise a standard imageinformation for a standard 3D face model; (c2) a step to extract featurepoints of said input image by analyzing the similarity in imageinformation of the featured shape and that of the standard image.
 48. Amethod to generate a 3D face model according to claim 45, the step (a)to input said 2D image provides a facility to zoom in, zoom out orrotate said image upon user's demand, and the step (b) comprises: (b1) astep to input the size and degree of rotation of the said image by theuser; (b2) a step to generate a vertical center line for the face and toinput base points for outline profile of the face, the step (c)comprises: (c1) a step to generate base snake of the face by the saidbase points of the said image of the face; (c2) a step to extractoutline profile of the face by moving said snake to the direction wheretexture of the face exist; (c3) a step to comprise standard imageinformation for 3D face model; (c4) a step to extract feature points ofsaid input image by analyzing the similarity in image information of thefeatured shape and that of the standard image; (c5) a step to displaythe outline profile or the feature points along the outline profile tothe user, and to provide a facility to modify said profile or featurepoints, and to finalize the outline profile and feature points of saidface.
 49. A method to generate a 3D face model according to claim 45further comprises: (e) a step to generate 3D face model by deformingsaid face image information using the movement of base feature points inthe standard image information to extracted feature points by userinteraction on said face image.
 50. A method to generate a 3D face modelaccording to claim 49, the step (e) comprises: (e1) a step to generateSibson coordinates on the original position of the base points extractedfrom the step to deform said face model; (e2) a step to calculatemovements of each base points to the corresponding position of saidimage information; (e3) a step to calculate a new position with asummation of coordinates of the original positions and said movements;(e4) a step to generate 3D face model that corresponds to adjusted imageinformation, by new positions, of said face.
 51. A method to generate a3D face model according to claim 49, the step (e) comprises: (e1) a stepto calculate the movement of base points; (e2) a step to calculate newpositions of base points and their vicinity that have by using saidmovement; (e3) a step to generate 3D face model that corresponds toadjusted image information, by new positions, of said face.
 52. A methodto generate a 3D face model according to claim 45 further comprises: (f)a step to generate facial expressions by deforming said 3D face modelgenerated from said step to create a 3D face model and by usingadditional information provided by the user.
 53. A method to generate a3D face model according to claim 52, the step (f) comprises: (f1) a stepto compute the first light intensity on the entire points over the 3Dface model; (f2) a step to compute the second light intensity of theimage information provided by the user; (f3) a step to calculate the ERI(Expression Ratio Intensity) value with the ratio of said second lightintensity over that of said second; (f4) a step to warp polygons of theface model by using the ERI value to generate human expressions.
 54. Amethod to generate a 3D face model according to claim 45 furthercomprises: (g) a step to combine photo image information of the frontand side view of the face, and to generate textures of the remainingparts of the head that are unseen by said photo image.
 55. A method togenerate a 3D face model according to claim 54, the step (g) comprises:(g1) a step to generate Cartesian coordinates of said 3D face model andto generate texture coordinates of the front and side image of the face;(g2) a step to extract a border of said two images and to project theborder onto the front and side views to generate textures in thevicinity of the border on the front and side views; (g3) a step to blendtextures from the front and side views by referencing acquired textureon the border.
 56. A method to generate a 3D face model according toclaim 45 further comprises: (h) a step to provide a facility for theuser to select a hair models from a built-in library of 3D hair models,and to fit said hair model onto said 3D face model.
 57. A method togenerate a 3D face model according to claim 54, the step (h) comprises:(h1) a step to comprise a library of 3D hair models in at least onecategory in hair style; (h2) a step for the user to select a hair modelfrom the built-in library of 3D hair models; (h3) a step to extract afitting point for the 3D hair model that matches the top position of thescalp on the vertical center line of said 3D face model; (h4) a step tocalculate the scale that matches to said 3D face model, and to fit 3Dhair and face model together by using said fitting point for the hair.58. A method for 3D simulation of eyeglasses comprising: (a) a step toacquire photographic image information from front, side and top views ofeyeglasses placed in a cubic box with a measure in transparent material;(b) a step to generate a base 3D model for eyeglasses by using measuredvalue from said images or by combining components from a built-inlibrary for 3D eyeglasses component models and textures; (c) a step togenerate a 3D lens model parametrically with the geometric informationabout lens shape, curvature, slope and focus angle; (d) a step togenerate a shape of the bridge and frame of eyeglasses by using measuredvalue from said image and to combine said lenses, bridge and frame modeltogether to generate a 3D complete model for eyeglasses.
 59. A methodfor 3D simulation of eyeglasses according to claim 58, the step (c)comprises: (c1) a step to acquire curvature information from said imagesor by specification of the product, and to create a sphere model thatmatches said curvature or predefined curvature preference; (c2) a stepto project the outline profile the lens to the surface of the spheremodel and to trim out inner part of the projected surface.
 60. A methodfor 3D simulation of eyeglasses according to claim 59 further comprises:(c3) a step to generate thickness on trimmed surface of the lens.
 61. Amethod for 3D simulation of eyeglasses according to claim 58, the step(d) comprises: (d1) a step to display the base 3D model to the user, andto acquire input parameters for adjusting the 3D frame model, and todeform said frame model with acquired parameters; (d2) a step to mirrorsaid 3D lens model with respect to center line defined by user input ormeasured by said photo images and generate a pair of lenses in symmetry,and to generate a 3D bridge model with the parameters defined by userinput or measured by said photo images.
 62. A method for 3D simulationof eyeglasses according to claim 61, the step (d) further comprises:(d3) a step to generate a connection part of the 3D frame model betweentemple and lens frame with the parameters defined by user input ormeasured by said photo images, or by the built-in 3D component library.63. A method for 3D simulation of eyeglasses according to claim 58further comprises: (e) a step to generate temple part of the 3D framemodel with the parameters defined by user input or measured by saidphoto images, or by the built-in 3D component library, while matchingtopology of said connection part and to convert automatically in aformat of polygons; (f) a step to deform temple part of the 3D framemodel to match the curvature measured by said photo images or predefinedcurvature preference; (g) a step to mirror said 3D temple model withrespect to center line defined by user input or measured by said photoimages and generate a pair of lenses in symmetry.
 64. A method for 3Dsimulation of eyeglasses according to claim 58 further comprises: (h) astep to generate a nose part, a hinge part, screws, bolts and nuts fromwith the parameters defined by user input or built-in 3D componentlibrary.
 65. A method for 3D simulation of eyeglasses comprising: (a) astep to comprise at least one 3D eyeglasses and 3D face modelinformation; (b) a step to select a 3D face model and 3D eyeglassesmodel by a user from said model information; (c) a step to fitautomatically said face and eyeglasses model at-real time; (d) a step tocompose a 3D image of said face and eyeglasses model, and to displaygenerated said 3D image upon the user's demand.
 66. A method for 3Dsimulation of eyeglasses according to claim 65, the step (c) comprises:(c1) a step to adjust to the scale of the 3D eyeglasses model inX-direction, that is the lateral direction of the 3D face model, withthe fitting points for hinge part of the 3D eyeglasses model, forcorresponding fitting points in 3D face model, for top center of the earpart of the 3D face model, for gap distance between eyes and lenses;(c2) a step to transform the coordinates and the location of 3Deyeglasses model in Y-direction, that is up and downward direction tothe 3D face model, and Z-direction, that is front and backward directionto the 3D face model, with the scale calculated in X-direction; (c3) astep to deform temple part of the 3D eyeglasses model to matchcorresponding fitting points between 3D face and eyeglasses model.
 67. Amethod for 3D simulation of eyeglasses according to claim 66, the step(c1) comprises the scale factor that scales the size of 3D eyeglassesmodel for automatic fitting represented by:SF=X _(B) /X _(B)′,g=SF·G Where, SF is the scale factor, X_(B)′ is the X-coordinate of thefitting point B′ for the hinge part of 3D eyeglasses model and X_(B) isthe X-coordinate of the corresponding fitting point B for the 3D facemodel, G is the size of original 3D eyeglasses model and g is a scaledsize of the model in X-direction.
 68. A method for 3D simulation ofeyeglasses according to claim 67 comprises the movement in Y-directionto close the gap between the fitting point B for 3D face model and thescaled fitting point b′ by said scale factor for the hinge part of 3Deyeglasses model represented by: $\begin{matrix}{{\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}} \\{b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}\end{matrix}$ Where, ΔY is the movement of 3D eyeglasses model inY-direction, (X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fittingpoint B′ for the hinge part of the 3D eyeglasses model, (X_(B), Y_(B),Z_(B)) are the coordinates of the corresponding fitting point B for the3D face model and Y_(b′) is the Y-coordinate of the scaled fitting pointb′
 69. A method for 3D simulation of eyeglasses according to claim 65comprises the movement in Z-direction to close the gap between thefitting point A for 3D face model and the scaled fitting point a′ bysaid scale factor for the hinge part of 3D eyeglasses model representedby:${\Delta\quad Z} = {{\left( {Z_{A} + \alpha} \right) - Z_{a^{\prime}}} = {{Z_{A} + \alpha - {{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}a^{\prime}}} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}}$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point a′ and α is the relative distance between thetop centers of the lens and the eyebrow.
 70. A method for 3D simulationof eyeglasses according to claim 65 comprises the rotation angle θ_(y)in X-Z plane with respect to Y-axis represented by the angle calculatedfrom cosine function represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 71. A method for3D simulation of eyeglasses according to claim 65 comprises the rotationangle θ_(x) in Y-Z plane with respect to X-axis represented by the anglecalculated from cosine function represented by:Cos θ_(x)=Cos(∠CB′C′)_(Y-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 72. A method for3D simulation of eyeglasses according to claim 65, the step (c)comprises: (c1) a step to input center points of the fitting region, NF,CF, DF, NG, HG and CG, in that 3D eyeglasses model and 3D face modelcontact each other, where NF is the center point of said 3D face model,CF is the center top of the ear part of said 3D face model that contactsthe temple part of the 3D eyeglasses model during virtual-try-on, DF isthe point at the top of the scalp, NG is the center of the nose part ofsaid 3D face model that contacts the nose pad part of the 3D eyeglassesmodel during virtual-try-on, HG is the rotational center of hinge partof the 3D eyeglasses model and CG is the center of inner side of thetemple part of the 3D eyeglasses model that contact said ear part of the3D face model; (c2) a step to obtain new coordinates set for said 3Deyeglasses model using said value of NF, CF, DF, NG, HG and CG that areneed to fit eyeglasses on face model; (c3) a step to fit said 3Deyeglasses model on said 3D face model automatically at-real time.
 73. Amethod for 3D simulation of eyeglasses according to claim 72, the step(c2) comprises; (c2i) a step to move said 3D eyeglasses model to properposition by using the difference of said NF and said NG; (c2ii) a stepfor the user to input his or her own PD, pupillary distance, and tocalculate PD value of said 3D face and corresponding value of 3Deyeglasses model; (c2iii) a step to calculate the rotation angles forthe template part of said eyeglasses model in horizontal plane to befitted on said 3D face model by using said CF and HG value; (c2iv) astep to deform 3D eyeglasses model and to fit on said 3D face model byusing said values and angles.
 74. A method for 3D simulation ofeyeglasses according to claim 73, the step (c2ii) comprises a step todefine a value between 63 and 72 millimeters without having input fromthe user.
 75. An eyeglasses marketing method comprising: (a) a step togenerate 3D face model of a user a with a photo image of the face, andto generate image information to combine said 3D face model and stored3D eyeglasses model, and to deliver said image information to acustomer; (b) a step to retrieve at least one selection of the 3Deyeglasses model by the user, and to manage purchase inquiry informationof the eyeglasses, that corresponds to 3D eyeglasses model, inputted bythe user; (c) a step to analyze the environment where said purchaseinquiry occurs including analysis or occasion of customer behavior onthe corresponding inquiry and eyeglass product; (d) a step to analyzethe customer's preference on eyeglasses product inquired and to managethe preference result; (e) a step to forecast trend future trend offashion driven from said analysis step for product preference andanalysis result for customer behavior and acquired information oneyeglasses fashion; (f) a step to acquire future trend of fashion by anartificial intelligent learning tool dedicated to fashion trendforecast, and to generate a knowledge base that advise suited design orproper fashion trend upon customer's request; (g) a step to generate apromotional contents for eyeglasses for a specific customer based on theintegrated information about customer preference obtained from saidcustomer behavior analysis tool, advising information generated by saidknowledge base and artificial intelligent learning tool; (h) a step toacquire and manage demographic information of the user including emailaddress or phone numbers and to publish promotional contents using 3Dsimulative features, and to deliver promotional contents to the multipletelecommunication form factors of the customer.
 76. An eyeglassesmarketing method according to claim 75, the step (g) comprises: a stepto categorize customers by a predefined rule and to generate promotionalcontents according to said category.
 77. An eyeglasses marketing methodaccording to claim 75, the step (d) and (e) comprises analysis for thecustomer that includes at least one parameter for hair texture of 3Dface model of the customer, lighting of the face, skin tone, width ofthe face, length of the face, size of the mouth, interpupillary distanceand race of the customer.
 78. An eyeglasses marketing method accordingto claim 75, the step (d) comprises the analysis for the eyeglassesproduct that includes at least one parameter for size of the frame andlenses, shape of the frame and lenses, material of the frame and lenses,color of the frame, color of the lenses, model year, brand and price.79. An eyeglasses marketing method according to claim 75, the step (d)comprises analysis for the product preference that includes at least oneparameter for seasonal trend in fashion, seasonal trend of eyeglassesshape, width of the face, race, skin tone, interpupillary distance, andhair style in the 3D face model.
 80. A device to generate a 3D facemodel comprising: an operative to input a 2D photo image of a face infront view and to display said image and to input at least one basepoints, on the said image, that characterizes a human face; an operativeto extract an outline profile and feature points for eyes, nose, mouthand ears that construct feature shapes of said face; an operative toconvert said input image information to a 3D face model using saidoutline profile and feature points.
 81. A device to generate a 3D facemodel according to claim 80, the base points include at least one pointsin the outline profile of the face, and said operative to extract theoutline profile of the face comprises: an operative to generate a basesnake on said face information on said image referencing said basepoints; an operative to extract the outline profile by moving snake ofthe said face to the direction where textures of the face exist.
 82. Adevice to generate a 3D face model according to claim 80, the basepoints include at least one points that correspond to eyes, nose, mouthand ears, and the operative to extract the outline profile of the facecomprises: a database to comprise a standard image information for astandard 3D face model; an operative to extract feature points of saidinput image by analyzing the similarity in image information of thefeatured shape and that of the standard image.
 83. A device to generatea 3D face model according to claim 80, the operative to input said 2Dimage provides a facility to zoom in, zoom out or rotate said image uponuser's demand, retrieves the size and degree of rotation of the saidimage by the user, and generates a vertical center line for the face andto input base points for outline profile of the face, the operative toextract the outline profile of the face comprises: an operative togenerate base snake of the face by the said base points of the saidimage of the face and to extract outline profile of the face by movingsaid snake to the direction where texture of the face exist; anoperative to comprise a database of standard image information for 3Dface model; an operative to extract feature points of said input imageby analyzing the similarity in image information of the featured shapeand that of the standard image; an operative to display the outlineprofile or the feature points along the outline profile to the user, andto provide a facility to modify said profile or feature points, and tofinalize the outline profile and feature points of said face.
 84. Adevice to generate a 3D face model according to claim 80 furthercomprises: an operative to generate 3D face model by deforming said faceimage information using the movement of base feature points in thestandard image information to extracted feature points by userinteraction on said face image.
 85. A device to generate a 3D face modelaccording to claim 84, the operative to deform 3D face model comprises:an operative to generate Sibson coordinates on the original position ofthe base points extracted from the operative to deform said face model;an operative to calculate movements of each base points to thecorresponding position of said image information; an operative tocalculate a new position with a summation of coordinates of the originalpositions and said movements; (e4) an operative to generate 3D facemodel that corresponds to adjusted image information, by new positions,of said face.
 86. A device to generate a 3D face model according toclaim 84, the operative to deform 3D face model: an operative tocalculate the movement of base points; an operative to calculate newpositions of base points and their vicinity that have by using saidmovement; an operative to generate 3D face model that corresponds toadjusted image information, by new positions, of said face.
 87. A deviceto generate a 3D face model according to claim 80 further comprises anoperative to generate facial expressions by deforming said 3D face modelgenerated from said operative to create a 3D face model and by usingadditional information provided by the user.
 88. A device to generate a3D face model according to claim 87, the operative to generate facialexpressions comprises: an operative to compute the first light intensityon the entire points over the 3D face model; an operative to compute thesecond light intensity of the image information provided by the user;(f3) an operative to calculate the ERI (Expression Ratio Intensity)value with the ratio of said second light intensity over that of saidsecond; (f4) an operative to warp polygons of the face model by usingthe ERI value to generate human expressions.
 89. A device to generate a3D face model according to claim 80 further comprises: an operative tocombine photo image information of the front and side view of the face,and to generate textures of the remaining parts of the head that areunseen by said photo image.
 90. A device to generate a 3D face modelaccording to claim 89, the operative comprises: an operative to generateCartesian coordinates of said 3D face model and to generate texturecoordinates of the front and side image of the face; an operative toextract a border of said two images and to project the border onto thefront and side views to generate textures in the vicinity of the borderon the front and side views; an operative to blend textures from thefront and side views by referencing acquired texture on the border. 91.A device to generate a 3D face model according to claim 80 furthercomprises: an operative to provide a facility for the user to select ahair models from a built-in library of 3D hair models, and to fit saidhair model onto said 3D face model.
 92. A device to generate a 3D facemodel according to claim 91, the operative comprises: an operative tocomprise a library of 3D hair models in at least one category in hairstyle; an operative for the user to select a hair model from thebuilt-in library of 3D hair models; an operative to extract a fittingpoint for the 3D hair model that matches the top position of the scalpon the vertical center line of said 3D face model; an operative tocalculate the scale that matches to said 3D face model, and to fit 3Dhair and face model together by using said fitting point for the hair.93. A device to generate a 3D eyeglasses model comprising: an operativeto acquire photographic image information from front, side and top viewsof eyeglasses placed in a cubic box with a measure in transparentmaterial; an operative to generate a base 3D model for eyeglasses byusing measured value from said images; an operative to generate a 3Dlens model parametrically with the geometric information about lensshape, curvature, slope and focus angle; an operative to generate ashape of the bridge and frame of eyeglasses by using measured value fromsaid image and to combine said lenses, bridge and frame model togetherto generate a 3D complete model for eyeglasses.
 94. A device to generatea 3D eyeglasses model according to claim 93, the operative to generate a3D lens model comprises: an operative to acquire curvature informationfrom said images and to create a sphere model that matches saidcurvature or predefined curvature preference; an operative to projectthe outline profile the lens to the surface of the sphere model and totrim out inner part of the projected surface.
 95. A device to generate a3D eyeglasses model according to claim 94 further comprises: anoperative to generate thickness on trimmed surface of the lens.
 96. Adevice to generate a 3D eyeglasses model according to claim 93, theoperative to generate a 3D model comprises: an operative to display thebase 3D model to the user, and to acquire input parameters for adjustingthe 3D frame model, and to deform said frame model with acquiredparameters; an operative to mirror said 3D lens model with respect tocenter line defined by user input or measured by said photo images andgenerate a pair of lenses in symmetry, and to generate a 3D bridge modelwith the parameters defined by user input or measured by said photoimages.
 97. A device to generate a 3D eyeglasses model according toclaim 96, the operative to generate a 3D model comprises furthercomprises: an operative to generate a connection part of the 3D framemodel between temple and lens frame with the parameters defined by userinput or measured by said photo images, or by built-in 3D componentlibrary.
 98. A device to generate a 3D eyeglasses model according toclaim 93 further comprises: an operative to generate temple part of the3D frame model while matching topology of said connection part and toconvert automatically in a format of polygons; an operative a step todeform temple part of the 3D frame model to match the curvature measuredby said photo images or predefined curvature preference; an operative astep to mirror said 3D temple model with respect to center line definedby user input or measured by said photo images and generate a pair oflenses in symmetry.
 99. A device to generate a 3D eyeglasses modelaccording to claim 93 further comprises: an operative to generate a nosepart, a hinge part, screws, bolts and nuts from with the parametersdefined by user input or built-in 3D component library.
 100. A devicefor 3D simulation of eyeglasses comprising: a database that comprises atleast one 3D eyeglasses and 3D face model information; an operative toselect a 3D face model and 3D eyeglasses model by a user from said modelinformation; an operative to fit automatically said face and eyeglassesmodel at-real time; an operative to compose a 3D image of said face andeyeglasses model, and to display generated said 3D image upon the user'sdemand.
 101. A device for 3D simulation of eyeglasses according to claim100, the operative to fit eyeglasses model comprises: an operative toadjust to the scale of the 3D eyeglasses model in X-direction, that isthe lateral direction of the 3D face model, with the fitting points forhinge part of the 3D eyeglasses model, for corresponding fitting pointsin 3D face model, for top center of the ear part of the 3D face model,for gap distance between eyes and lenses; an operative to transform thecoordinates and the location of 3D eyeglasses model in Y-direction, thatis up and downward direction to the 3D face model, and Z-direction, thatis front and backward direction to the 3D face model, with the scalecalculated in X-direction; an operative to deform temple part of the 3Deyeglasses model to match corresponding fitting points between 3D faceand eyeglasses model.
 102. A device for 3D simulation of eyeglassesaccording to claim 101, the operative to adjust the scale comprises thescale factor that scales the size of 3D eyeglasses model for automaticfitting represented by:SF=X _(B) /X _(B)′,g=SF·G Where, SF is the scale factor, X_(B)′ is the X-coordinate of thefitting point B′ for the hinge part of 3D eyeglasses model and X_(B) isthe X-coordinate of the corresponding fitting point B for the 3D facemodel, G is the size of original 3D eyeglasses model and g is a scaledsize of the model in X-direction.
 103. A device for 3D simulation ofeyeglasses according to claim 102 comprises the movement in Y-directionto close the gap between the fitting point B for 3D face model and thescaled fitting point b′ by said scale factor for the hinge part of 3Deyeglasses model represented by:${\Delta\quad Y} = {{Y_{B} - Y_{b^{\prime}}} = {Y_{B} - {Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}}}$$b^{\prime} = \left( {X_{B}^{\prime},{Y_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{B}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)$Where, ΔY is the movement of 3D eyeglasses model in Y-direction,(X_(B)′, Y_(B)′, Z_(B)′) are the coordinates of the fitting point B′ forthe hinge part of the 3D eyeglasses model, (X_(B), Y_(B), Z_(B)) are thecoordinates of the corresponding fitting point B for the 3D face modeland Y_(b′) is the Y-coordinate of the scaled fitting point b′
 104. Adevice for 3D simulation of eyeglasses according to claim 101 comprisesthe movement in Z-direction to close the gap between the fitting point Afor 3D face model and the scaled fitting point a′ by said scale factorfor the hinge part of 3D eyeglasses model represented by:${\Delta\quad Z} = {{\left( {Z_{A} + \alpha} \right) - Z_{a^{\prime}}} = {{Z_{A} + \alpha - {{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}a^{\prime}}} = \left( {X_{A}^{\prime},{Y_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}},{Z_{A}^{\prime} \cdot \frac{X_{B}}{X_{B}^{\prime}}}} \right)}}$where, ΔZ is the movement of 3D eyeglasses model in Z-direction,(X_(A)′, Y_(A)′, Z_(A)′) are the coordinates of the fitting point A′ forthe top center of a lens in the 3D eyeglasses model, (X_(A), Y_(A),Z_(A)) are the coordinates of the corresponding fitting point A for topcenter of an eyebrow in the 3D face model, Z_(a′) is the Z-coordinate ofthe scaled fitting point a′ and α is the relative distance between thetop centers of the lens and the eyebrow.
 105. A device for 3D simulationof eyeglasses according to claim 101 comprises the rotation angle θ_(y)in X-Z plane with respect to Y-axis represented by the angle calculatedfrom cosine function represented by:Cos θ_(y)=Cos(∠CB′C′)_(X-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 106. A device for3D simulation of eyeglasses according to claim 101 comprises therotation angle θ_(x) in Y-Z plane with respect to X-axis represented bythe angle calculated from cosine function represented by:Cos θ_(x)=Cos(∠CB′C′)_(Y-Z) where, C is the fitting point for thevertical top point in the ear of the 3D face model that contacts withtemple part of the 3D eyeglasses model, C′ is the corresponding fittingpoint for the temple part of the 3D eyeglasses model and B′ is thefitting point for the hinge part of the 3D eyeglasses.
 107. A device for3D simulation of eyeglasses according to claim 100, the operative to fit3D eyeglasses comprises: an operative to input center points of thefitting region, NF, CF, DF, NG, HG and CG, in that 3D eyeglasses modeland 3D face model contact each other, where NF is the center point ofsaid 3D face model, CF is the center top of the ear part of said 3D facemodel that contacts the temple part of the 3D eyeglasses model duringvirtual-try-on, DF is the point at the top of the scalp, NG is thecenter of the nose part of said 3D face model that contacts the nose padpart of the 3D eyeglasses model during virtual-try-on, HG is therotational center of hinge part of the 3D eyeglasses model and CG is thecenter of inner side of the temple part of the 3D eyeglasses model thatcontact said ear part of the 3D face model; an operative to obtain newcoordinates set for said 3D eyeglasses model using said value of NF, CF,DF, NG, HG and CG that are need to fit eyeglasses on face model; anoperative to fit said 3D eyeglasses model on said 3D face modelautomatically at-real time.
 108. A device for 3D simulation ofeyeglasses according to claim 107, the operative to obtain newcoordinates comprises; an operative to move said 3D eyeglasses model toproper position by using the difference of said NF and said NG; anoperative a step for the user to input his or her own PD, pupillarydistance, and to calculate PD value of said 3D face and correspondingvalue of 3D eyeglasses model; an operative a step to calculate therotation angles for the template part of said eyeglasses model inhorizontal plane to be fitted on said 3D face model by using said CF andHG value; an operative a step to deform 3D eyeglasses model and to fiton said 3D face model by using said values and angles.
 109. A device for3D simulation of eyeglasses according to claim 73, the step (c2ii)comprises a step to define a value between 63 and 72 millimeters withouthaving input from the user.
 110. A device for marketing of eyeglassescomprising: an operative to generate 3D face model of a user a with aphoto image of the face, and to generate image information to combinesaid 3D face model and stored 3D eyeglasses model, and to deliver saidimage information to a customer; an operative to retrieve at least oneselection of the 3D eyeglasses model by the user, and to manage purchaseinquiry information of the eyeglasses, that corresponds to 3D eyeglassesmodel, inputted by the user; an operative to analyze the environmentwhere said purchase inquiry occurs including analysis or occasion ofcustomer behavior on the corresponding inquiry and eyeglass product; anoperative to analyze the customer's preference on eyeglasses productinquired and to manage the preference result; an operative to forecasttrend future trend of fashion driven from said analysis step for productpreference and analysis result for customer behavior and acquiredinformation on eyeglasses fashion; an operative to acquire future trendof fashion by an artificial intelligent learning tool dedicated tofashion trend forecast, and to generate a knowledge base that advisesuited design or proper fashion trend upon customer's request; anoperative to generate a promotional contents for eyeglasses for aspecific customer based on the integrated information about customerpreference obtained from said customer behavior analysis tool, advisinginformation generated by said knowledge base and artificial intelligentlearning tool; an operative to acquire and manage demographicinformation of the user including email address or phone numbers, and todeliver promotional contents to the customer as an 1:1 marketing tool.111. A device for marketing of eyeglasses according to claim 110, theoperative to provide 1:1 marketing tool comprises: an operative tocategorize customers by a predefined rule and to generate promotionalcontents according to said category and to publish promotional contentsusing 3D simulative features for eyeglasses.
 112. A device for marketingof eyeglasses according to claim 110 comprises analysis for the customerthat includes at least one parameter for hair texture of 3D face modelof the customer, lighting of the face, skin tone, width of the face,length of the face, size of the mouth, interpupillary distance and raceof the customer.
 113. A device for marketing of eyeglasses according toclaim 110 comprises the analysis for the eyeglasses product thatincludes at least one parameter for size of the frame and lenses, shapeof the frame and lenses, material of the frame and lenses, color of theframe, color of the lenses, model year, brand and price.
 114. A devicefor marketing of eyeglasses according to claim 110 comprises analysisfor the product preference that includes at least one parameter forseasonal trend in fashion, seasonal trend of eyeglasses shape, width ofthe face, race, skin tone, interpupillary distance, and hair style inthe 3D face model
 115. A storage media to read a program from a computerto execute a method in claim 45 by a computer.
 116. A storage media toread a program from a computer to execute a method in claim 79 by acomputer.